-- Logs begin at Mon 2021-11-15 11:58:03 UTC, end at Mon 2021-11-15 12:57:23 UTC. -- Nov 15 12:30:55.053666 dv-cinder-680889-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 15 12:30:55.061613 dv-cinder-680889-10-iscsi devstack@n-api.service[107589]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 15 12:30:55.064179 dv-cinder-680889-10-iscsi devstack@n-api.service[107589]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Nov 15 12:30:55 2021] *** Nov 15 12:30:55.064179 dv-cinder-680889-10-iscsi devstack@n-api.service[107589]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 15 12:30:55.064179 dv-cinder-680889-10-iscsi devstack@n-api.service[107589]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 15 12:30:55.064179 dv-cinder-680889-10-iscsi devstack@n-api.service[107589]: nodename: dv-cinder-680889-10-iscsi Nov 15 12:30:55.064179 dv-cinder-680889-10-iscsi devstack@n-api.service[107589]: machine: x86_64 Nov 15 12:30:55.064179 dv-cinder-680889-10-iscsi devstack@n-api.service[107589]: clock source: unix Nov 15 12:30:55.064179 dv-cinder-680889-10-iscsi devstack@n-api.service[107589]: pcre jit disabled Nov 15 12:30:55.064179 dv-cinder-680889-10-iscsi devstack@n-api.service[107589]: detected number of CPU cores: 4 Nov 15 12:30:55.064179 dv-cinder-680889-10-iscsi devstack@n-api.service[107589]: current working directory: / Nov 15 12:30:55.064179 dv-cinder-680889-10-iscsi devstack@n-api.service[107589]: detected binary path: /usr/bin/uwsgi-core Nov 15 12:30:55.064789 dv-cinder-680889-10-iscsi devstack@n-api.service[107589]: your processes number limit is 47680 Nov 15 12:30:55.064789 dv-cinder-680889-10-iscsi devstack@n-api.service[107589]: your memory page size is 4096 bytes Nov 15 12:30:55.064789 dv-cinder-680889-10-iscsi devstack@n-api.service[107589]: detected max file descriptor number: 2048 Nov 15 12:30:55.064789 dv-cinder-680889-10-iscsi devstack@n-api.service[107589]: lock engine: pthread robust mutexes Nov 15 12:30:55.064789 dv-cinder-680889-10-iscsi devstack@n-api.service[107589]: thunder lock: enabled Nov 15 12:30:55.064789 dv-cinder-680889-10-iscsi devstack@n-api.service[107589]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 15 12:30:55.064789 dv-cinder-680889-10-iscsi devstack@n-api.service[107589]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 15 12:30:55.110692 dv-cinder-680889-10-iscsi devstack@n-api.service[107589]: Python main interpreter initialized at 0x5644c44089c0 Nov 15 12:30:55.110692 dv-cinder-680889-10-iscsi devstack@n-api.service[107589]: python threads support enabled Nov 15 12:30:55.110692 dv-cinder-680889-10-iscsi devstack@n-api.service[107589]: your server socket listen backlog is limited to 100 connections Nov 15 12:30:55.110692 dv-cinder-680889-10-iscsi devstack@n-api.service[107589]: your mercy for graceful operations on workers is 90 seconds Nov 15 12:30:55.111098 dv-cinder-680889-10-iscsi devstack@n-api.service[107589]: mapped 403077 bytes (393 KB) for 2 cores Nov 15 12:30:55.111186 dv-cinder-680889-10-iscsi devstack@n-api.service[107589]: *** Operational MODE: preforking *** Nov 15 12:30:55.111412 dv-cinder-680889-10-iscsi devstack@n-api.service[107589]: *** uWSGI is running in multiple interpreter mode *** Nov 15 12:30:55.111412 dv-cinder-680889-10-iscsi devstack@n-api.service[107589]: spawned uWSGI master process (pid: 107589) Nov 15 12:30:55.111623 dv-cinder-680889-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 15 12:30:55.113244 dv-cinder-680889-10-iscsi devstack@n-api.service[107589]: spawned uWSGI worker 1 (pid: 107590, cores: 1) Nov 15 12:30:55.113244 dv-cinder-680889-10-iscsi devstack@n-api.service[107589]: spawned uWSGI worker 2 (pid: 107591, cores: 1) Nov 15 12:30:55.113244 dv-cinder-680889-10-iscsi devstack@n-api.service[107589]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 15 12:30:56.782557 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 15 12:30:56.782557 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: from cryptography.utils import int_from_bytes Nov 15 12:30:56.783259 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 15 12:30:56.783259 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: from cryptography.utils import int_from_bytes Nov 15 12:30:56.828695 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 15 12:30:56.828695 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: from cryptography.utils import int_from_bytes Nov 15 12:30:56.829303 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 15 12:30:56.829303 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: from cryptography.utils import int_from_bytes Nov 15 12:30:59.317041 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 15 12:30:59.317608 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 15 12:30:59.317812 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 15 12:30:59.318167 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 15 12:30:59.318417 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 15 12:30:59.318822 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.319146 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.319462 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.319802 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.320113 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.320419 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.320735 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.321052 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.321378 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.321628 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.321938 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.322258 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-680889-10-iscsi {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.322576 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.322902 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.323209 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.323522 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.323823 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.324144 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.324466 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.325069 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.325530 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.327309 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.327309 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.327309 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.327309 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.327309 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.327631 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.327768 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.328075 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.328471 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.328878 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-680889-10-iscsi {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.329197 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.331883 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.331883 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.332051 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 15 12:30:59.332436 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.332525 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 15 12:30:59.332609 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.332695 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 15 12:30:59.332778 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.332778 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.332913 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 15 12:30:59.332999 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.333076 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 15 12:30:59.333158 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.333240 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.333315 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.333394 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.333477 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.333558 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.333633 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.333712 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.333788 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.333861 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.333943 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.334025 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.334099 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.334181 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.334256 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.334355 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.334433 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.334513 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.334588 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.334668 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.334859 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.334941 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.335022 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.335192 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-680889-10-iscsi {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.335311 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.335516 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.335624 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.335821 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.335911 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.336126 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.336215 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.336403 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.336511 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.336654 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.336739 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.336966 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.337062 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.337283 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.337383 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.337588 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.337809 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.337920 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.338118 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.338206 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.338422 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.338570 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.338726 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.338892 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.339064 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.339195 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.339369 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.339500 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.339672 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.339809 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.339986 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.340116 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.340292 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.340423 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.340605 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.340739 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.340909 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.341056 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.341223 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.341364 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-680889-10-iscsi {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.341602 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.341738 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.341884 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.342016 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.342142 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.342293 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.342478 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.342609 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.342812 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.342916 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.343120 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.343206 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.343435 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.343526 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.343751 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.343849 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.344053 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.344138 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.344355 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.344447 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.344657 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.344751 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.344973 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.345058 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.345301 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.345386 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.345601 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.345694 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.345848 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.345941 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.346145 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.346233 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.346445 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.346538 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.346845 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.346935 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.347153 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.347228 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.347455 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.347544 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.347755 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.347847 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.348052 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.348137 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.348353 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.348445 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.348653 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.348740 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.348927 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.349024 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.349178 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.349263 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.349496 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.349580 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.349815 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.349908 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.350117 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.350203 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.350418 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.350502 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.350717 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.350847 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.351050 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.351141 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.351357 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.351441 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.351658 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.351751 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.351958 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.352049 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.352258 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.352353 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.352560 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.352647 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.352873 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.352957 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.353171 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.353254 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.353473 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.353558 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.353788 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.353872 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.354087 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.354175 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.354387 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.354479 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.354699 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.354839 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.355026 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.355124 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.355326 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.355462 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.355640 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.355735 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.355935 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.356026 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.356235 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.356330 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.356547 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.356637 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.356855 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.356948 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.357159 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.357243 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.357456 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.357539 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.357756 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.357852 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.358057 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.358142 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.358328 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.358412 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.358629 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.358722 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.358976 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.359071 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.359275 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.359361 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.359586 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.359748 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.359893 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.359978 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.360199 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.360301 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.360496 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.360581 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.360794 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.360877 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.361096 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.361180 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.361403 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.361489 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.361708 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.361800 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.362012 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.362103 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.362871 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.363001 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.363211 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.363308 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.363480 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.363594 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.363773 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.363859 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.364087 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.364172 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.364414 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.364508 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.364720 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.364805 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.365026 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.365109 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.365332 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.365429 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.365638 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.365722 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.365952 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.366038 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.366255 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.366397 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.366560 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.366647 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.366899 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.366999 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.367204 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.367297 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.367508 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.367593 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.367814 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.367898 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.368117 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.368210 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.368423 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.368507 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.368740 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.368825 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.369039 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.369131 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.369344 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.369429 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.369660 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.369744 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.369968 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.370060 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.370272 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.370356 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.370575 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.370659 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.370904 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.370994 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.371207 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.371294 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.371510 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.371594 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.371812 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.371898 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.372114 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.372200 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.372410 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.372501 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.372721 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.372805 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.373037 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.373135 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.373342 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.373427 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.373646 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.373733 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.373949 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.374037 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.374251 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.374337 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:30:59.374554 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.374641 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.374882 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.374973 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.375185 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.375281 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.375501 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.375588 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.375821 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.375913 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.376125 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.376224 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.376456 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.376541 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.376761 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.376846 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.377067 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.377160 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.377379 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.377474 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.377681 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.377767 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.378553 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.378716 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.378871 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.378950 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.379208 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.379291 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.379499 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.379586 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.379807 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.379897 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.380113 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.380199 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.380432 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.380518 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.380739 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.380823 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.381043 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.381128 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.381357 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.381443 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.381666 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.381758 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.381974 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.382060 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.382282 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.382377 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.382603 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.382697 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.382938 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.383040 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.383251 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.383340 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.383583 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.383673 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.383892 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.383989 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.384201 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.384292 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.384518 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.384603 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.384831 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.384932 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.385144 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.385229 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.385445 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.385528 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.385750 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.385845 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.386053 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.386138 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.386355 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.386446 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.386657 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.386753 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.386986 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.387072 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.387293 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.387378 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.387597 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.387690 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.387898 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.387983 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.388199 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.388285 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.388500 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.388589 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.388816 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.388900 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.389124 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.389208 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.389425 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.389511 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.389726 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.389812 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.390027 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.390125 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.390338 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.390422 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.390646 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.390730 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.390975 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.391073 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.391285 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.391395 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.391593 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.391710 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.391895 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.392030 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.392216 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.392339 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.392525 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.392649 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.392829 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.392955 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.393149 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.393277 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.393456 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.393621 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.393783 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.393884 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.394099 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.394199 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.394407 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.394493 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.394715 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.394847 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.395048 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.395135 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.395368 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.395461 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.395679 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.395766 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.395989 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.396076 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.396312 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.396396 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.396625 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.396710 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.396926 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.397010 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.397250 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.397335 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.397571 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.397657 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.397883 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.397969 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.398185 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.398279 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.398494 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.398579 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.398818 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.398907 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.399123 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.399220 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.399427 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.399511 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.399731 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.399814 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.400032 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.400126 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.400336 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.400421 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.400662 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.400801 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.400940 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.401034 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.401238 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.401322 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.401553 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.401637 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.401857 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.401951 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.402157 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.402249 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.402456 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.402539 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.402756 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.402862 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.403114 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.403203 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.403418 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.403509 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.403723 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.403815 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.404039 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.404131 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.404345 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.404429 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.404652 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.404737 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.404958 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.405049 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.405257 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.405350 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.405556 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.405649 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.405861 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.405947 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.406168 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.406259 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.406470 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.406641 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.406793 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.406896 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.407088 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.407186 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.407403 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.407487 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.407709 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.407801 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.408009 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.408104 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.408309 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.408394 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.408613 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.408698 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.408914 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.408999 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.409743 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.409847 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.410109 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.410286 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.410441 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.410723 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.410830 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.411060 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.411145 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.411367 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.411536 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.411679 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.411763 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.411988 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.412072 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.412288 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.412384 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.412593 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.412679 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.412898 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.413024 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.413211 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.413311 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.413515 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.413613 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.413830 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.413924 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.414135 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.414243 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.414447 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.414541 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.414752 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.414905 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.415084 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.415177 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.415383 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.415467 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.415685 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.415769 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.416006 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.416099 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.416318 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.416485 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.416626 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.416712 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.416934 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.417028 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.417242 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.417327 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.417547 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.417640 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.417857 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.417958 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.418163 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.418246 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.418467 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.418562 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.418790 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.418891 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.419102 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.419197 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.419405 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.419499 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.419712 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.419837 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.420019 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.420103 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.420324 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.420588 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.420674 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.420918 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.421009 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.421223 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.421316 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.421528 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.421613 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.421839 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.421923 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.422150 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.422243 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.422459 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.422550 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.422800 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.422890 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.423113 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.423210 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.423416 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.423502 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.423718 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.423799 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.424016 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.424118 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.424316 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.424402 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.424623 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.424742 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.425465 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.425643 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.425772 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.425957 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.426116 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.426262 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.426427 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.426569 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.426732 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.426906 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.427069 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.427210 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.427389 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.427558 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.427697 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.427862 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.428008 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.428182 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.428309 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.428481 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.428608 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.428787 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.428927 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.429087 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.429238 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.429409 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.429546 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.429715 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.429856 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.430016 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.430166 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.430315 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.430474 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.430612 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.431058 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.431240 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.431390 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.431544 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.431679 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.431881 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.431989 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.432209 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.432303 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.432550 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.432637 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.432855 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.432948 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.433159 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.433255 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.433482 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.433739 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.433825 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.434073 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.434166 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.434372 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.434465 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.434678 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.434763 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.435011 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.435109 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.435312 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.435398 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.435620 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.435712 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.435927 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.436022 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.436233 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.436328 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.436539 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.436625 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.436835 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.436918 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.437134 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.437226 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.437433 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.437518 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.437737 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.437822 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.438040 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.438125 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.438340 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.438432 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.438640 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.438726 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.438969 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.439056 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.439268 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.439354 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.439567 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.439652 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.439873 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.439958 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.440172 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.440256 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.440510 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.440617 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.440814 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.441073 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.441162 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.441395 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.441486 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.441698 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.441783 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.442000 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.442085 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.442299 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.442384 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.442608 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.442693 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.442933 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.443021 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.443237 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.443335 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.443538 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.443624 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.444315 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.444422 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.444510 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.444598 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.444678 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.444760 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.444844 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.444968 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.445060 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.445149 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.445323 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.445411 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.445623 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.445708 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.445927 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.446020 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.446227 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.446312 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.446524 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.446609 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.446844 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.446934 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.447150 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.447235 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.447449 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.447534 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.447748 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.447835 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.448052 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.448137 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.448349 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.448465 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.448648 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.448736 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.448953 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.449042 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.449256 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.449340 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.449558 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.449687 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.449856 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.449941 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.450154 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.450252 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.450451 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.450535 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.450752 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.450902 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.451085 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.451184 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.451389 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.451474 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.451691 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.451776 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.451997 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.452095 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.452298 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.452383 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.452607 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.452693 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.452910 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.453004 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.453208 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.453294 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.453506 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.453597 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.453811 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.453897 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.454124 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.454230 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.454413 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.454499 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.454709 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.454818 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.455053 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.455138 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.455351 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.455446 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.455651 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.455742 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.455973 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.456122 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.456281 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.456370 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.456581 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.456801 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.456885 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.456961 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.457185 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.457278 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.457490 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.457588 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.457787 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.457914 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.458092 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.458189 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.458392 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.458476 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.458690 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.458823 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.459015 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.459120 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.459316 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.459408 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.459614 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.459699 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.459913 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.460007 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.460213 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.460336 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.460514 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.460601 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.460813 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.460899 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.461111 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.461206 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.461423 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.461507 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.461724 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.461810 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.462022 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.462106 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.462318 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.462409 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.462658 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.462751 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.462984 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.463071 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.463283 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.463368 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.463626 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.463719 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.463943 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.464028 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.464260 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.464421 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.464569 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.464655 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.464879 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.464963 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.465181 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.465275 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.465480 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.465564 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.465786 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.465870 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.466087 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.466181 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.466394 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.466499 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.466695 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.466838 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.467018 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.467148 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.467336 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.467456 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.467644 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.467757 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.467951 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.468070 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.468268 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.468376 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.468588 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.468700 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.468906 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.468992 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.469207 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.469299 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.469512 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.469599 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.469818 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.469904 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.470121 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.470206 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.470424 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.470509 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.470728 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.470894 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.471057 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.471204 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.471365 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.471508 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.472194 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.472483 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.472588 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.472752 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.472901 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.473059 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.473214 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.473379 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.473522 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.473698 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.473829 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.474020 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.474133 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.474322 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.474463 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.474633 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.474787 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.474963 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.475089 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.475285 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.475394 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.475605 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.475691 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.475913 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.476000 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.476223 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.476308 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.476525 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.476706 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.476845 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.477017 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.477164 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.477326 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.477475 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.477628 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.477796 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.477935 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.478202 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.478294 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.478529 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.478627 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.478859 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.478950 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.479161 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.479294 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.479489 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.479588 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.479796 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.479889 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.480096 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.480190 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.480402 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.480535 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.480702 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.480789 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.481004 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.481090 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.481324 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.481410 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.481627 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.481726 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.481932 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.482018 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.482234 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.482320 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.482536 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.482621 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.482860 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.482960 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.483162 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.483256 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.483479 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.483574 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.483780 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.483895 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.484098 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.484205 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.484413 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.484545 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.484727 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.484916 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.485055 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.485225 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.485315 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.485531 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.485637 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.485852 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.485937 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.486176 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.486276 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.486498 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.486632 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.486821 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.486913 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.487136 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.487269 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.488006 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.488213 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.488336 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.488589 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.488761 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.488920 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.489079 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.489249 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.489396 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.489558 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.489700 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.489888 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.490023 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.490212 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.490347 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.490525 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.490660 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.490862 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.491013 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.491189 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.491426 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.491523 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.491754 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.491853 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.492060 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.492156 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.492370 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.492504 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.492671 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.492758 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.492975 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.493076 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.493276 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.493378 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.493575 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.493668 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.493875 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.493962 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.494176 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.494284 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.494493 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.494582 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.494827 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.494917 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.495123 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.495257 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.495427 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.495512 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.495730 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.495825 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.496030 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.496123 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.496326 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.496413 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.496645 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.496739 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.496950 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.497043 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.497272 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.497359 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.497584 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.497678 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.497902 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.497988 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.498220 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.498334 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.498524 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.498618 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.498864 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.498951 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.499172 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.499258 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.499478 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.499575 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.499780 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.499867 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.500081 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.500173 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.500388 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.500481 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.500700 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.500785 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.501009 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.501109 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.501313 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.501400 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.501624 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.501709 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.501933 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.502018 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.502244 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.502331 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.502574 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.502820 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.503008 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.503166 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.503462 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.503594 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.503794 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.503923 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.504103 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.504236 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.504415 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.504546 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.504725 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.504856 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.505032 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.505165 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.505338 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.505457 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.505642 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.505762 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.505954 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.506069 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.506258 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.506392 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.506561 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.506708 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.506888 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.507056 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.507212 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.507389 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.507517 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.507695 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.507839 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.507997 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.508147 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.508306 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.508452 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.508619 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.508755 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.508979 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.509068 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.509293 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.509379 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.509598 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.509684 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.509907 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.509991 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.510218 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.510303 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.510530 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.510623 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.510862 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.510953 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.511169 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.511256 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.511478 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.511612 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.511787 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.511874 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.512093 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.512257 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.512397 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.512484 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.512706 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.512791 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.513014 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.513109 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.513331 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.513418 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.513659 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.513744 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.513967 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.514061 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.514272 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.514356 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.514581 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.514667 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.514917 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.515017 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.515432 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.515524 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.515741 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.515836 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.516071 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.516165 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.516378 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.516463 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.516691 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.516776 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.517004 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.517091 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.517317 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.517401 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.517624 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.517709 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.517932 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.518056 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.518236 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.518322 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.518579 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.518685 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.518942 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.519080 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.519267 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.519358 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.519594 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.519753 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.519941 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.520034 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.520242 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.520335 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.520555 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.520650 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.520861 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.520946 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.521175 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.521389 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.521541 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.521738 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.521857 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.522052 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.522163 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.522377 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.522471 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.522701 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.522877 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.523044 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.523142 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.523353 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.523447 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.523677 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.523763 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.523984 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.524071 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.524289 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.524375 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.524601 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.524692 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.524908 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.524993 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.525208 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.525300 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.525510 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.525602 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.525818 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.525903 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.526125 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.526211 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.526427 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.526513 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.526734 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.526851 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.527062 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.527148 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.527373 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.527459 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.527675 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.527891 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.527978 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.528208 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.528295 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.528542 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.528627 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.528858 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.528943 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.529160 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.529245 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.529462 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.529547 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.529763 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.529857 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.530071 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.530156 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.530372 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.530470 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.530679 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.530762 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.531005 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.531089 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.531311 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.531409 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.531611 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.531703 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.531917 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.532013 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.532219 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.532312 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.532521 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.532606 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.532830 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.532972 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.533131 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.533230 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.533445 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.533653 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.533739 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.534001 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.534631 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.534916 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.535006 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.535276 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.535416 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.535689 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.535782 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.536006 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.536092 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.536339 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.536530 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.536663 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.536912 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.536999 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.537229 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.537316 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.537564 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.537656 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.537874 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.537960 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.538177 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.538268 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.538478 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.538576 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.538804 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.538893 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.539109 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.539193 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.539413 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.539508 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.539716 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.539801 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.540016 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.540100 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.540318 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.540419 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.540622 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.540708 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.540923 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.541007 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.541225 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.541319 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.541530 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.541769 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.541899 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.541985 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.542120 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.542207 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.542420 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.542505 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.542723 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.542839 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.543058 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.543145 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.543362 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.543446 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.543669 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.543761 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.543973 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.544059 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.544276 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.544360 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.544576 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.544661 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.544884 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.544970 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.545185 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.545276 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.545503 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.545596 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.545804 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.545897 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.546103 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.546217 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.546416 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.546510 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.546725 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.546854 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.547070 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.547165 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.547381 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.547480 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.547691 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.547777 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.548044 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.548129 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.548354 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.548442 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.548675 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.548879 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.548973 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.549262 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.549424 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.549582 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.549668 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.550467 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.550565 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.550828 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.550933 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.551140 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.551226 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.551447 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.551532 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.551752 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.551846 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.552071 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.552157 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.552381 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.552466 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.552690 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.552777 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.552998 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.553132 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.553303 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.553390 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.553606 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.553692 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.553911 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.553997 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.554215 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.554301 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.554523 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.554661 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.554858 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.555106 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.555261 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.555423 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.555513 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.556060 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.556151 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.556420 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.556544 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.556734 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.556825 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.557042 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.557136 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.557348 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.557434 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.557655 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.557740 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.557960 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.558045 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.558273 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.558359 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.558600 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.558688 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.558933 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.559023 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.559238 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.559337 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.559556 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.559650 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.559871 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.559956 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.560183 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.560277 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.560492 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.560578 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.560816 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.560902 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.561124 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.561218 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.561438 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.561523 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.561745 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.561832 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.562054 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.562140 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.562366 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.562451 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.562677 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.562763 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.563027 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.563115 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.563351 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.563448 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.563672 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.563757 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.563976 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.564063 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.564277 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.564363 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.564577 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.564671 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.564887 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.564974 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.565216 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.565307 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.565583 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.565679 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.565895 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.565988 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.566198 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.566439 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 15 12:30:59.566524 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.566764 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.567372 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.567704 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.568022 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.568339 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.568649 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.568980 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.569292 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.569601 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.569910 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.570218 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.570527 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.570861 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.571189 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.571514 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.571820 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.572144 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.572461 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.572777 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.573089 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.573399 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.573738 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.574046 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.574361 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.574672 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.575015 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.575334 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.575649 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.575975 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.576300 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.576622 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.576947 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.577292 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.577604 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.577946 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.578274 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.578587 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.578932 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.579239 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:30:59.579482 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 15 12:30:59.589092 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG oslo_db.sqlalchemy.engines [None req-6508fb8f-0c04-4a7e-bac2-3f2ccc90064e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107591) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 15 12:30:59.602372 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG oslo_db.sqlalchemy.engines [None req-93ee7132-49c7-4bb7-b68c-73af62faa804 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107590) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 15 12:30:59.656480 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.context [None req-6508fb8f-0c04-4a7e-bac2-3f2ccc90064e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),388e2b35-2c0f-43c3-b3c8-e061c392ccce(cell1) {{(pid=107591) load_cells /opt/stack/nova/nova/context.py:464}} Nov 15 12:30:59.661265 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG oslo_concurrency.lockutils [None req-6508fb8f-0c04-4a7e-bac2-3f2ccc90064e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:30:59.662861 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG oslo_concurrency.lockutils [None req-6508fb8f-0c04-4a7e-bac2-3f2ccc90064e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:30:59.663660 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG oslo_concurrency.lockutils [None req-6508fb8f-0c04-4a7e-bac2-3f2ccc90064e None None] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:30:59.665574 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG oslo_concurrency.lockutils [None req-6508fb8f-0c04-4a7e-bac2-3f2ccc90064e None None] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:30:59.669652 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.context [None req-93ee7132-49c7-4bb7-b68c-73af62faa804 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),388e2b35-2c0f-43c3-b3c8-e061c392ccce(cell1) {{(pid=107590) load_cells /opt/stack/nova/nova/context.py:464}} Nov 15 12:30:59.673958 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG oslo_concurrency.lockutils [None req-93ee7132-49c7-4bb7-b68c-73af62faa804 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:30:59.676185 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG oslo_concurrency.lockutils [None req-93ee7132-49c7-4bb7-b68c-73af62faa804 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:30:59.676323 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG oslo_db.sqlalchemy.engines [None req-6508fb8f-0c04-4a7e-bac2-3f2ccc90064e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107591) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 15 12:30:59.677028 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG oslo_concurrency.lockutils [None req-93ee7132-49c7-4bb7-b68c-73af62faa804 None None] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:30:59.679107 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG oslo_concurrency.lockutils [None req-93ee7132-49c7-4bb7-b68c-73af62faa804 None None] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:30:59.679501 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG oslo_db.sqlalchemy.engines [None req-6508fb8f-0c04-4a7e-bac2-3f2ccc90064e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107591) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 15 12:30:59.691964 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG oslo_db.sqlalchemy.engines [None req-93ee7132-49c7-4bb7-b68c-73af62faa804 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107590) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 15 12:30:59.694487 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG oslo_db.sqlalchemy.engines [None req-93ee7132-49c7-4bb7-b68c-73af62faa804 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107590) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 15 12:30:59.942069 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG oslo_db.sqlalchemy.engines [None req-6508fb8f-0c04-4a7e-bac2-3f2ccc90064e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107591) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 15 12:30:59.958373 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG oslo_db.sqlalchemy.engines [None req-93ee7132-49c7-4bb7-b68c-73af62faa804 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107590) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 15 12:31:00.288468 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: WARNING keystonemiddleware.auth_token [None req-6508fb8f-0c04-4a7e-bac2-3f2ccc90064e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 15 12:31:00.294956 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: WARNING keystonemiddleware.auth_token [None req-6508fb8f-0c04-4a7e-bac2-3f2ccc90064e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 15 12:31:00.304032 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: WARNING keystonemiddleware.auth_token [None req-93ee7132-49c7-4bb7-b68c-73af62faa804 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 15 12:31:00.311018 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: WARNING keystonemiddleware.auth_token [None req-93ee7132-49c7-4bb7-b68c-73af62faa804 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 15 12:31:00.517910 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: WARNING keystonemiddleware.auth_token [None req-6508fb8f-0c04-4a7e-bac2-3f2ccc90064e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 15 12:31:00.523687 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: WARNING keystonemiddleware.auth_token [None req-6508fb8f-0c04-4a7e-bac2-3f2ccc90064e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 15 12:31:00.529847 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5644c44089c0 pid: 107591 (default app) Nov 15 12:31:00.531924 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-6508fb8f-0c04-4a7e-bac2-3f2ccc90064e None None] Calling method '>' {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:31:00.533072 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-6508fb8f-0c04-4a7e-bac2-3f2ccc90064e None None] 10.222.0.43 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001709 Nov 15 12:31:00.533474 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 788 bytes} [Mon Nov 15 12:31:00 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:31:00.538592 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: WARNING keystonemiddleware.auth_token [None req-93ee7132-49c7-4bb7-b68c-73af62faa804 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 15 12:31:00.543787 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: WARNING keystonemiddleware.auth_token [None req-93ee7132-49c7-4bb7-b68c-73af62faa804 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 15 12:31:00.550550 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5644c44089c0 pid: 107590 (default app) Nov 15 12:32:23.208616 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-6508fb8f-0c04-4a7e-bac2-3f2ccc90064e None None] Calling method '>' {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:32:23.210243 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-6508fb8f-0c04-4a7e-bac2-3f2ccc90064e None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002056 Nov 15 12:32:23.213349 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 2/2] 10.222.0.43 () {54 vars in 930 bytes} [Mon Nov 15 12:32:23 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:32:23.786220 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-80719d2f-d9d3-4a3a-8ca2-c9cd3fecc717 admin admin] Calling method '>' {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:32:23.816958 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-80719d2f-d9d3-4a3a-8ca2-c9cd3fecc717 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.598554 Nov 15 12:32:23.817711 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 1/3] 10.222.0.43 () {60 vars in 1291 bytes} [Mon Nov 15 12:32:23 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:32:26.245384 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-6508fb8f-0c04-4a7e-bac2-3f2ccc90064e None None] Calling method '>' {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:32:26.246379 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-6508fb8f-0c04-4a7e-bac2-3f2ccc90064e None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Nov 15 12:32:26.246818 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 3/4] 10.222.0.43 () {54 vars in 930 bytes} [Mon Nov 15 12:32:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:32:26.314307 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-49adc4eb-61c3-44c6-81d2-e4af9c263244 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "c1", "swap": 0, "ram": 256, "disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "rxtx_factor": 1.0}} {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:32:26.334742 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:32:26.334742 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: warnings.warn(msg) Nov 15 12:32:26.371561 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-49adc4eb-61c3-44c6-81d2-e4af9c263244 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.117582 Nov 15 12:32:26.378049 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 2/5] 10.222.0.43 () {64 vars in 1282 bytes} [Mon Nov 15 12:32:26 2021] POST /compute/v2.1/flavors => generated 407 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:32:26.712122 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-12059541-0fda-4686-90ff-4a5fa23fa8f5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:32:26.714395 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:32:26.714395 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: warnings.warn(msg) Nov 15 12:32:26.766039 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-12059541-0fda-4686-90ff-4a5fa23fa8f5 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.384173 Nov 15 12:32:26.766815 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 4/6] 10.222.0.43 () {64 vars in 1335 bytes} [Mon Nov 15 12:32:26 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:32:29.184922 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-49adc4eb-61c3-44c6-81d2-e4af9c263244 admin admin] Calling method '>' {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:32:29.185940 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-49adc4eb-61c3-44c6-81d2-e4af9c263244 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Nov 15 12:32:29.186345 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 3/7] 10.222.0.43 () {54 vars in 930 bytes} [Mon Nov 15 12:32:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:32:29.333050 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-933ee71c-0de0-48f7-91ad-c32e58035ef8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "id": "d1", "swap": 0, "name": "ds512M", "vcpus": 1, "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:32:29.351963 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:32:29.351963 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: warnings.warn(msg) Nov 15 12:32:29.373494 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-933ee71c-0de0-48f7-91ad-c32e58035ef8 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.179121 Nov 15 12:32:29.374358 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 5/8] 10.222.0.43 () {64 vars in 1282 bytes} [Mon Nov 15 12:32:29 2021] POST /compute/v2.1/flavors => generated 404 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:32:29.386829 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-ad99a98b-d527-4b1d-9dc9-15bd3c912e43 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:32:29.388520 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:32:29.388520 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: warnings.warn(msg) Nov 15 12:32:29.421929 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-ad99a98b-d527-4b1d-9dc9-15bd3c912e43 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038613 Nov 15 12:32:29.422516 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 4/9] 10.222.0.43 () {64 vars in 1335 bytes} [Mon Nov 15 12:32:29 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:32:31.959552 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-933ee71c-0de0-48f7-91ad-c32e58035ef8 admin admin] Calling method '>' {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:32:31.960578 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-933ee71c-0de0-48f7-91ad-c32e58035ef8 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Nov 15 12:32:31.960985 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 6/10] 10.222.0.43 () {54 vars in 930 bytes} [Mon Nov 15 12:32:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:32:32.047493 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-971e286d-bf5c-4676-a85a-9b3e1be81e87 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "ds1G", "swap": 0, "rxtx_factor": 1.0, "disk": 10}} {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:32:32.072777 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-971e286d-bf5c-4676-a85a-9b3e1be81e87 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.091801 Nov 15 12:32:32.074799 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 5/11] 10.222.0.43 () {64 vars in 1282 bytes} [Mon Nov 15 12:32:31 2021] POST /compute/v2.1/flavors => generated 404 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:32:32.086083 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-397048a5-3d05-4c1b-848d-3538a2787819 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:32:32.112316 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-397048a5-3d05-4c1b-848d-3538a2787819 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028881 Nov 15 12:32:32.114833 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 7/12] 10.222.0.43 () {64 vars in 1335 bytes} [Mon Nov 15 12:32:32 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:32:34.545513 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-971e286d-bf5c-4676-a85a-9b3e1be81e87 admin admin] Calling method '>' {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:32:34.546524 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-971e286d-bf5c-4676-a85a-9b3e1be81e87 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Nov 15 12:32:34.547081 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 6/13] 10.222.0.43 () {54 vars in 930 bytes} [Mon Nov 15 12:32:34 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:32:34.632582 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-538e6b8c-efbd-45de-ba2a-b4f2a9d0a1bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "disk": 10, "name": "ds2G"}} {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:32:34.654703 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-538e6b8c-efbd-45de-ba2a-b4f2a9d0a1bf admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.094396 Nov 15 12:32:34.655999 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 8/14] 10.222.0.43 () {64 vars in 1282 bytes} [Mon Nov 15 12:32:34 2021] POST /compute/v2.1/flavors => generated 404 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:32:34.669839 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-85e63286-9b93-4fc7-861f-9a3821037871 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:32:34.695606 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-85e63286-9b93-4fc7-861f-9a3821037871 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030129 Nov 15 12:32:34.702815 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 7/15] 10.222.0.43 () {64 vars in 1335 bytes} [Mon Nov 15 12:32:34 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:32:37.107929 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-538e6b8c-efbd-45de-ba2a-b4f2a9d0a1bf admin admin] Calling method '>' {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:32:37.108845 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-538e6b8c-efbd-45de-ba2a-b4f2a9d0a1bf admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Nov 15 12:32:37.109242 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 9/16] 10.222.0.43 () {54 vars in 930 bytes} [Mon Nov 15 12:32:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:32:37.180374 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-9043f78d-0499-4361-af35-82e663f7f48b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "d4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "name": "ds4G", "disk": 20, "ram": 4096}} {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:32:37.202060 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-9043f78d-0499-4361-af35-82e663f7f48b admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.085383 Nov 15 12:32:37.202983 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 8/17] 10.222.0.43 () {64 vars in 1282 bytes} [Mon Nov 15 12:32:37 2021] POST /compute/v2.1/flavors => generated 404 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:32:37.215180 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-2769cbf8-402f-4c66-8e52-cfb4549c4676 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:32:37.246514 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-2769cbf8-402f-4c66-8e52-cfb4549c4676 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034759 Nov 15 12:32:37.247812 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 10/18] 10.222.0.43 () {64 vars in 1335 bytes} [Mon Nov 15 12:32:37 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:32:39.628997 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-9043f78d-0499-4361-af35-82e663f7f48b admin admin] Calling method '>' {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:32:39.630015 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-9043f78d-0499-4361-af35-82e663f7f48b admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Nov 15 12:32:39.630421 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 9/19] 10.222.0.43 () {54 vars in 930 bytes} [Mon Nov 15 12:32:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 15 12:32:39.692345 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-9d3afdea-e222-4fdb-837c-6804fa466416 admin admin] Calling method '>' {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:32:39.716496 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-9d3afdea-e222-4fdb-837c-6804fa466416 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079292 Nov 15 12:32:39.717041 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 11/20] 10.222.0.43 () {60 vars in 1291 bytes} [Mon Nov 15 12:32:39 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:32:42.109977 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-9043f78d-0499-4361-af35-82e663f7f48b admin admin] Calling method '>' {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:32:42.111760 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-9043f78d-0499-4361-af35-82e663f7f48b admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002290 Nov 15 12:32:42.112483 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 10/21] 10.222.0.43 () {54 vars in 930 bytes} [Mon Nov 15 12:32:42 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:32:42.176038 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-3cabaf12-4eb7-47eb-a82e-fe022e38c574 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "name": "m1.tiny", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "ram": 512, "os-flavor-access:is_public": true}} {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:32:42.196413 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-3cabaf12-4eb7-47eb-a82e-fe022e38c574 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.076945 Nov 15 12:32:42.202878 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 12/22] 10.222.0.43 () {64 vars in 1282 bytes} [Mon Nov 15 12:32:42 2021] POST /compute/v2.1/flavors => generated 402 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:32:42.209850 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-f1ddc4ca-c84d-4438-be54-e4cd12e274a2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:32:42.233118 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-f1ddc4ca-c84d-4438-be54-e4cd12e274a2 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027041 Nov 15 12:32:42.233693 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 11/23] 10.222.0.43 () {64 vars in 1332 bytes} [Mon Nov 15 12:32:42 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:32:45.108640 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-3cabaf12-4eb7-47eb-a82e-fe022e38c574 admin admin] Calling method '>' {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:32:45.109578 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-3cabaf12-4eb7-47eb-a82e-fe022e38c574 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Nov 15 12:32:45.110141 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 13/24] 10.222.0.43 () {54 vars in 930 bytes} [Mon Nov 15 12:32:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:32:45.173988 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-5bfe2723-e6d9-435d-96b9-5355ca8c2dd4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "disk": 20, "vcpus": 1, "ram": 2048, "swap": 0, "id": "2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:32:45.193001 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-5bfe2723-e6d9-435d-96b9-5355ca8c2dd4 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075255 Nov 15 12:32:45.193560 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 12/25] 10.222.0.43 () {64 vars in 1282 bytes} [Mon Nov 15 12:32:45 2021] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:32:45.206669 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-9519c029-93c6-4e5b-9c81-80424c99afd0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:32:45.230849 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-9519c029-93c6-4e5b-9c81-80424c99afd0 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028242 Nov 15 12:32:45.231429 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 14/26] 10.222.0.43 () {64 vars in 1332 bytes} [Mon Nov 15 12:32:45 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:32:47.638038 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-5bfe2723-e6d9-435d-96b9-5355ca8c2dd4 admin admin] Calling method '>' {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:32:47.639157 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-5bfe2723-e6d9-435d-96b9-5355ca8c2dd4 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Nov 15 12:32:47.639637 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 13/27] 10.222.0.43 () {54 vars in 930 bytes} [Mon Nov 15 12:32:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:32:47.697617 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-d3afd851-34f5-40dc-859a-0a147d729eae admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 40, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "vcpus": 2}} {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:32:47.720114 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-d3afd851-34f5-40dc-859a-0a147d729eae admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.073449 Nov 15 12:32:47.720539 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 15/28] 10.222.0.43 () {64 vars in 1282 bytes} [Mon Nov 15 12:32:47 2021] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:32:47.733357 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-bc125710-0236-4072-8dca-092f712ae607 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:32:47.759621 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-bc125710-0236-4072-8dca-092f712ae607 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030193 Nov 15 12:32:47.760211 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 14/29] 10.222.0.43 () {64 vars in 1332 bytes} [Mon Nov 15 12:32:47 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:32:50.247374 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-d3afd851-34f5-40dc-859a-0a147d729eae admin admin] Calling method '>' {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:32:50.248521 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-d3afd851-34f5-40dc-859a-0a147d729eae admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Nov 15 12:32:50.248999 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 16/30] 10.222.0.43 () {54 vars in 930 bytes} [Mon Nov 15 12:32:50 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:32:50.316405 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-52bdbc1d-292b-4f96-aa25-034795a0bd2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "4", "ram": 8192, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80}} {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:32:50.340445 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-52bdbc1d-292b-4f96-aa25-034795a0bd2b admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.083812 Nov 15 12:32:50.341318 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 15/31] 10.222.0.43 () {64 vars in 1282 bytes} [Mon Nov 15 12:32:50 2021] POST /compute/v2.1/flavors => generated 405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:32:50.355097 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-1a0d5d80-9bdb-4983-8308-079bf690951e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:32:50.383911 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-1a0d5d80-9bdb-4983-8308-079bf690951e admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032272 Nov 15 12:32:50.384525 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 17/32] 10.222.0.43 () {64 vars in 1332 bytes} [Mon Nov 15 12:32:50 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:32:52.816022 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-52bdbc1d-292b-4f96-aa25-034795a0bd2b admin admin] Calling method '>' {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:32:52.817070 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-52bdbc1d-292b-4f96-aa25-034795a0bd2b admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Nov 15 12:32:52.817468 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 16/33] 10.222.0.43 () {54 vars in 930 bytes} [Mon Nov 15 12:32:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 15 12:32:52.916334 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-69ac31da-dfeb-4603-9afd-bf63d717d9a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "disk": 160, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 16384, "id": "5", "rxtx_factor": 1.0}} {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:32:52.939370 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-69ac31da-dfeb-4603-9afd-bf63d717d9a7 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.115151 Nov 15 12:32:52.939929 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 18/34] 10.222.0.43 () {64 vars in 1282 bytes} [Mon Nov 15 12:32:52 2021] POST /compute/v2.1/flavors => generated 408 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:32:52.952150 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-ab6fc0ee-6665-4f20-a546-71114ad7b9f9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:32:52.979587 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-ab6fc0ee-6665-4f20-a546-71114ad7b9f9 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030970 Nov 15 12:32:52.980810 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 17/35] 10.222.0.43 () {64 vars in 1332 bytes} [Mon Nov 15 12:32:52 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:33:32.432073 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-69ac31da-dfeb-4603-9afd-bf63d717d9a7 admin admin] Calling method '>' {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:33:32.433115 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-69ac31da-dfeb-4603-9afd-bf63d717d9a7 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Nov 15 12:33:32.433512 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 19/36] 10.222.0.43 () {54 vars in 930 bytes} [Mon Nov 15 12:33:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:33:32.492339 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-f7e9e58e-d1b1-401b-ad45-6553f624b893 admin admin] Calling method '>' {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:33:32.509384 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-f7e9e58e-d1b1-401b-ad45-6553f624b893 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068085 Nov 15 12:33:32.509919 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 18/37] 10.222.0.43 () {60 vars in 1291 bytes} [Mon Nov 15 12:33:32 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:33:34.065778 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-69ac31da-dfeb-4603-9afd-bf63d717d9a7 admin admin] Calling method '>' {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:33:34.066793 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-69ac31da-dfeb-4603-9afd-bf63d717d9a7 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Nov 15 12:33:34.067216 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 20/38] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Nov 15 12:33:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:33:34.265048 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-3f7f7bcc-0e0d-438c-ac38-53a653418a79 admin admin] Calling method '>' {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:33:34.271516 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.wsgi [None req-3f7f7bcc-0e0d-438c-ac38-53a653418a79 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 15 12:33:34.272023 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-3f7f7bcc-0e0d-438c-ac38-53a653418a79 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=107590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:33:34.272823 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-3f7f7bcc-0e0d-438c-ac38-53a653418a79 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061438 Nov 15 12:33:34.273335 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 19/39] 10.222.0.43 () {60 vars in 1190 bytes} [Mon Nov 15 12:33:34 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 15 12:33:34.285054 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-c7553438-d25b-4403-bd7e-30b52124e9aa admin admin] Calling method '>' {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:33:34.307456 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-c7553438-d25b-4403-bd7e-30b52124e9aa admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027428 Nov 15 12:33:34.308003 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 21/40] 10.222.0.43 () {60 vars in 1210 bytes} [Mon Nov 15 12:33:34 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:33:34.319270 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-ce0a440f-c44b-4535-b185-81090e9825bf admin admin] Calling method '>' {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:33:34.342448 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-ce0a440f-c44b-4535-b185-81090e9825bf admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026551 Nov 15 12:33:34.343028 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 20/41] 10.222.0.43 () {60 vars in 1210 bytes} [Mon Nov 15 12:33:34 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:33:34.353733 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-1491bda0-80c0-4e02-a1c1-0ef82219fb9d admin admin] Calling method '>' {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:33:34.359229 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.wsgi [None req-1491bda0-80c0-4e02-a1c1-0ef82219fb9d admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 15 12:33:34.359911 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-1491bda0-80c0-4e02-a1c1-0ef82219fb9d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=107591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:33:34.361257 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-1491bda0-80c0-4e02-a1c1-0ef82219fb9d admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011103 Nov 15 12:33:34.361767 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 22/42] 10.222.0.43 () {60 vars in 1190 bytes} [Mon Nov 15 12:33:34 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 15 12:33:35.841150 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-ce0a440f-c44b-4535-b185-81090e9825bf admin admin] Calling method '>' {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:33:35.842156 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-ce0a440f-c44b-4535-b185-81090e9825bf admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Nov 15 12:33:35.842551 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 21/43] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Nov 15 12:33:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:33:36.036457 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-bf659abd-2071-4897-bcd1-23fdee99c6ed admin admin] Calling method '>' {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:33:36.043809 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.wsgi [None req-bf659abd-2071-4897-bcd1-23fdee99c6ed admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 15 12:33:36.044403 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-bf659abd-2071-4897-bcd1-23fdee99c6ed admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=107591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:33:36.045228 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-bf659abd-2071-4897-bcd1-23fdee99c6ed admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061239 Nov 15 12:33:36.045791 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 23/44] 10.222.0.43 () {60 vars in 1190 bytes} [Mon Nov 15 12:33:35 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 15 12:33:36.056275 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-aa16bfa7-f4ea-4658-ba64-f48c12d80a41 admin admin] Calling method '>' {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:33:36.070351 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-aa16bfa7-f4ea-4658-ba64-f48c12d80a41 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018075 Nov 15 12:33:36.070944 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 22/45] 10.222.0.43 () {60 vars in 1210 bytes} [Mon Nov 15 12:33:36 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 15 12:33:36.082068 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-c2b9fc0f-4bdc-41c5-b74e-c78519ab9900 admin admin] Calling method '>' {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:33:36.096331 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-c2b9fc0f-4bdc-41c5-b74e-c78519ab9900 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018722 Nov 15 12:33:36.096864 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 24/46] 10.222.0.43 () {60 vars in 1210 bytes} [Mon Nov 15 12:33:36 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:33:36.106744 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-12944157-d1fc-4904-96df-44593b05815a admin admin] Calling method '>' {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:33:36.112818 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.wsgi [None req-12944157-d1fc-4904-96df-44593b05815a admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 15 12:33:36.113379 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-12944157-d1fc-4904-96df-44593b05815a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=107590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:33:36.114159 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-12944157-d1fc-4904-96df-44593b05815a admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010888 Nov 15 12:33:36.114661 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 23/47] 10.222.0.43 () {60 vars in 1190 bytes} [Mon Nov 15 12:33:36 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 15 12:33:37.556354 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-c2b9fc0f-4bdc-41c5-b74e-c78519ab9900 admin admin] Calling method '>' {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:33:37.557346 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-c2b9fc0f-4bdc-41c5-b74e-c78519ab9900 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Nov 15 12:33:37.557745 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 25/48] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Nov 15 12:33:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:33:37.749054 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-8089f41a-0d19-4f6d-9393-dd2794b25abf admin admin] Calling method '>' {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:33:37.755389 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.wsgi [None req-8089f41a-0d19-4f6d-9393-dd2794b25abf admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 15 12:33:37.755946 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-8089f41a-0d19-4f6d-9393-dd2794b25abf admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=107590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:33:37.756729 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-8089f41a-0d19-4f6d-9393-dd2794b25abf admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059674 Nov 15 12:33:37.757232 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 24/49] 10.222.0.43 () {60 vars in 1193 bytes} [Mon Nov 15 12:33:37 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 15 12:33:37.767683 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-f9a3092d-4786-4924-b616-2f809867c87d admin admin] Calling method '>' {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:33:37.780802 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-f9a3092d-4786-4924-b616-2f809867c87d admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017280 Nov 15 12:33:37.781966 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 26/50] 10.222.0.43 () {60 vars in 1210 bytes} [Mon Nov 15 12:33:37 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:33:37.792796 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-a4f03c69-33b7-4f88-83a8-44b3e9467145 admin admin] Calling method '>' {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:33:37.806569 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-a4f03c69-33b7-4f88-83a8-44b3e9467145 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017632 Nov 15 12:33:37.807157 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 25/51] 10.222.0.43 () {60 vars in 1210 bytes} [Mon Nov 15 12:33:37 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:33:37.817248 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-7f75c6fc-6010-4ec0-972a-175807154941 admin admin] Calling method '>' {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:33:37.822520 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.wsgi [None req-7f75c6fc-6010-4ec0-972a-175807154941 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 15 12:33:37.823190 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-7f75c6fc-6010-4ec0-972a-175807154941 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=107591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:33:37.823970 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-7f75c6fc-6010-4ec0-972a-175807154941 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010342 Nov 15 12:33:37.824468 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 27/52] 10.222.0.43 () {60 vars in 1193 bytes} [Mon Nov 15 12:33:37 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 15 12:33:39.302389 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-a4f03c69-33b7-4f88-83a8-44b3e9467145 admin admin] Calling method '>' {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:33:39.303416 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-a4f03c69-33b7-4f88-83a8-44b3e9467145 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Nov 15 12:33:39.304072 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 26/53] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Nov 15 12:33:39 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:33:39.498022 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-22a94cb0-1ffe-4c96-b8fa-f8a57078c172 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:33:39.518191 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-22a94cb0-1ffe-4c96-b8fa-f8a57078c172 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.073081 Nov 15 12:33:39.518720 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 28/54] 10.222.0.43 () {64 vars in 1235 bytes} [Mon Nov 15 12:33:39 2021] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:33:40.985432 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-a4f03c69-33b7-4f88-83a8-44b3e9467145 admin admin] Calling method '>' {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:33:40.986480 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-a4f03c69-33b7-4f88-83a8-44b3e9467145 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002097 Nov 15 12:33:40.986920 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 27/55] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Nov 15 12:33:40 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:33:41.189503 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-95375f1a-0a1a-4a47-b259-37b9a254d4cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:33:41.207238 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-95375f1a-0a1a-4a47-b259-37b9a254d4cb admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.073779 Nov 15 12:33:41.207793 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 29/56] 10.222.0.43 () {64 vars in 1235 bytes} [Mon Nov 15 12:33:41 2021] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:33:42.634556 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-a4f03c69-33b7-4f88-83a8-44b3e9467145 admin admin] Calling method '>' {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:33:42.635597 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-a4f03c69-33b7-4f88-83a8-44b3e9467145 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Nov 15 12:33:42.635992 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 28/57] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Nov 15 12:33:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:33:42.837412 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-d4faf810-b9ab-4748-a699-75cc4e00c60b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:33:42.855661 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-d4faf810-b9ab-4748-a699-75cc4e00c60b admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.071801 Nov 15 12:33:42.856165 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 30/58] 10.222.0.43 () {64 vars in 1235 bytes} [Mon Nov 15 12:33:42 2021] POST /compute/v2.1/flavors => generated 407 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:33:44.294422 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-a4f03c69-33b7-4f88-83a8-44b3e9467145 admin admin] Calling method '>' {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:33:44.295456 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-a4f03c69-33b7-4f88-83a8-44b3e9467145 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Nov 15 12:33:44.295853 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 29/59] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Nov 15 12:33:44 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:33:44.486896 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-b35dac93-9afa-4452-bc37-b5ad3704f5d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:33:44.504883 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-b35dac93-9afa-4452-bc37-b5ad3704f5d5 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.070508 Nov 15 12:33:44.505429 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 31/60] 10.222.0.43 () {64 vars in 1235 bytes} [Mon Nov 15 12:33:44 2021] POST /compute/v2.1/flavors => generated 409 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:33:45.950633 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-a4f03c69-33b7-4f88-83a8-44b3e9467145 admin admin] Calling method '>' {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:33:45.951664 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-a4f03c69-33b7-4f88-83a8-44b3e9467145 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Nov 15 12:33:45.952058 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 30/61] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Nov 15 12:33:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:33:46.143123 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-d5ab8836-a852-4e60-9e8c-3be7ae2e04a3 admin admin] Calling method '>' {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:33:46.162726 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-d5ab8836-a852-4e60-9e8c-3be7ae2e04a3 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070853 Nov 15 12:33:46.163224 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 32/62] 10.222.0.43 () {60 vars in 1202 bytes} [Mon Nov 15 12:33:46 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:34:34.083224 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-a4f03c69-33b7-4f88-83a8-44b3e9467145 admin admin] Calling method '>' {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:34:34.084230 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-a4f03c69-33b7-4f88-83a8-44b3e9467145 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Nov 15 12:34:34.084616 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 31/63] 10.222.0.43 () {54 vars in 930 bytes} [Mon Nov 15 12:34:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:34:34.144055 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-02d814e8-53ef-433d-899e-487efe183266 admin admin] Calling method '>' {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:34:34.162857 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-02d814e8-53ef-433d-899e-487efe183266 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071802 Nov 15 12:34:34.163395 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 33/64] 10.222.0.43 () {60 vars in 1291 bytes} [Mon Nov 15 12:34:34 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:34:34.186078 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-ae848f1c-3b41-4d23-b98e-61141e9f06dd admin admin] Calling method '>' {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:34:34.194369 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-ae848f1c-3b41-4d23-b98e-61141e9f06dd admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011788 Nov 15 12:34:34.194931 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 32/65] 10.222.0.43 () {60 vars in 1282 bytes} [Mon Nov 15 12:34:34 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:34:34.206991 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-2c0d3655-8e55-4cb5-b27f-04ad05243d43 admin admin] Calling method '>' {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:34:34.214731 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-2c0d3655-8e55-4cb5-b27f-04ad05243d43 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011243 Nov 15 12:34:34.215291 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 34/66] 10.222.0.43 () {60 vars in 1285 bytes} [Mon Nov 15 12:34:34 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:34:34.227097 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-27ecee74-3685-495d-9646-cb877216689b admin admin] Calling method '>' {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:34:34.235161 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-27ecee74-3685-495d-9646-cb877216689b admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011511 Nov 15 12:34:34.235690 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 33/67] 10.222.0.43 () {60 vars in 1285 bytes} [Mon Nov 15 12:34:34 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:34:34.247336 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-cc41ddfb-1eb7-4041-9e2f-2c68386a52bf admin admin] Calling method '>' {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:34:34.255662 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-cc41ddfb-1eb7-4041-9e2f-2c68386a52bf admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011823 Nov 15 12:34:34.256184 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 35/68] 10.222.0.43 () {60 vars in 1282 bytes} [Mon Nov 15 12:34:34 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:35:58.738690 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-a7bf34ba-8537-405c-ad2a-c3d0bc74d05b tempest-verify_tempest_config-1615879010 tempest-verify_tempest_config-1615879010-project] Calling method '>' {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:35:58.740697 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-a7bf34ba-8537-405c-ad2a-c3d0bc74d05b tempest-verify_tempest_config-1615879010 tempest-verify_tempest_config-1615879010-project] 10.222.0.43 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.109763 Nov 15 12:35:58.741232 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 34/69] 10.222.0.43 () {58 vars in 1133 bytes} [Mon Nov 15 12:35:58 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:37:34.674455 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-cc41ddfb-1eb7-4041-9e2f-2c68386a52bf admin admin] Calling method '>' {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:37:34.675494 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-cc41ddfb-1eb7-4041-9e2f-2c68386a52bf admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Nov 15 12:37:34.675899 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 36/70] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Nov 15 12:37:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 15 12:37:34.937096 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-d9437e4b-a8af-46f1-b8fe-a6cab64585ed admin admin] Calling method '>' {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:37:34.938588 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:37:34.938588 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: warnings.warn(msg) Nov 15 12:37:34.940507 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG oslo_concurrency.lockutils [None req-d9437e4b-a8af-46f1-b8fe-a6cab64585ed admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:37:34.940964 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG oslo_concurrency.lockutils [None req-d9437e4b-a8af-46f1-b8fe-a6cab64585ed admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:37:34.941735 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG oslo_concurrency.lockutils [None req-d9437e4b-a8af-46f1-b8fe-a6cab64585ed admin admin] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:37:34.942269 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG oslo_concurrency.lockutils [None req-d9437e4b-a8af-46f1-b8fe-a6cab64585ed admin admin] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:37:34.976391 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-d9437e4b-a8af-46f1-b8fe-a6cab64585ed admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.157636 Nov 15 12:37:34.977348 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 35/71] 10.222.0.43 () {60 vars in 1193 bytes} [Mon Nov 15 12:37:34 2021] GET /compute/v2.1/os-services => generated 794 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:37:36.450386 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-cc41ddfb-1eb7-4041-9e2f-2c68386a52bf admin admin] Calling method '>' {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:37:36.451476 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-cc41ddfb-1eb7-4041-9e2f-2c68386a52bf admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Nov 15 12:37:36.451819 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 37/72] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Nov 15 12:37:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:37:36.645849 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-17b51771-fd0e-40e9-9666-e870d174de63 admin admin] Calling method '>' {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:37:36.647034 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:37:36.647034 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: warnings.warn(msg) Nov 15 12:37:36.648585 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG oslo_concurrency.lockutils [None req-17b51771-fd0e-40e9-9666-e870d174de63 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:37:36.649023 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG oslo_concurrency.lockutils [None req-17b51771-fd0e-40e9-9666-e870d174de63 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:37:36.649817 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG oslo_concurrency.lockutils [None req-17b51771-fd0e-40e9-9666-e870d174de63 admin admin] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:37:36.650235 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG oslo_concurrency.lockutils [None req-17b51771-fd0e-40e9-9666-e870d174de63 admin admin] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:37:36.668575 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-17b51771-fd0e-40e9-9666-e870d174de63 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.076197 Nov 15 12:37:36.669127 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 36/73] 10.222.0.43 () {60 vars in 1193 bytes} [Mon Nov 15 12:37:36 2021] GET /compute/v2.1/os-services => generated 794 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:37:48.599481 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-cc41ddfb-1eb7-4041-9e2f-2c68386a52bf admin admin] Calling method '>' {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:37:48.600490 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-cc41ddfb-1eb7-4041-9e2f-2c68386a52bf admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Nov 15 12:37:48.600885 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 38/74] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Nov 15 12:37:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:37:48.802326 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-5dd403c9-b19c-4fba-b0f0-7be368a079c3 admin admin] Calling method '>' {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:37:48.803505 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:37:48.803505 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: warnings.warn(msg) Nov 15 12:37:48.805034 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG oslo_concurrency.lockutils [None req-5dd403c9-b19c-4fba-b0f0-7be368a079c3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:37:48.805475 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG oslo_concurrency.lockutils [None req-5dd403c9-b19c-4fba-b0f0-7be368a079c3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:37:48.806289 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG oslo_concurrency.lockutils [None req-5dd403c9-b19c-4fba-b0f0-7be368a079c3 admin admin] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:37:48.806714 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG oslo_concurrency.lockutils [None req-5dd403c9-b19c-4fba-b0f0-7be368a079c3 admin admin] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:37:48.833010 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-5dd403c9-b19c-4fba-b0f0-7be368a079c3 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.084331 Nov 15 12:37:48.833505 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 37/75] 10.222.0.43 () {60 vars in 1193 bytes} [Mon Nov 15 12:37:48 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:37:50.346287 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: DEBUG nova.api.openstack.wsgi [None req-cc41ddfb-1eb7-4041-9e2f-2c68386a52bf admin admin] Calling method '>' {{(pid=107591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:37:50.347362 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: INFO nova.api.openstack.requestlog [None req-cc41ddfb-1eb7-4041-9e2f-2c68386a52bf admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002063 Nov 15 12:37:50.347768 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: [pid: 107591|app: 0|req: 39/76] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Nov 15 12:37:50 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:37:50.540966 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG nova.api.openstack.wsgi [None req-9703f792-601f-4f6a-b2f6-74dc78609009 admin admin] Calling method '>' {{(pid=107590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:37:50.542109 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:37:50.542109 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: warnings.warn(msg) Nov 15 12:37:50.543711 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG oslo_concurrency.lockutils [None req-9703f792-601f-4f6a-b2f6-74dc78609009 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:37:50.544148 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG oslo_concurrency.lockutils [None req-9703f792-601f-4f6a-b2f6-74dc78609009 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:37:50.544940 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG oslo_concurrency.lockutils [None req-9703f792-601f-4f6a-b2f6-74dc78609009 admin admin] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:37:50.545364 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: DEBUG oslo_concurrency.lockutils [None req-9703f792-601f-4f6a-b2f6-74dc78609009 admin admin] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:37:50.568062 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: INFO nova.api.openstack.requestlog [None req-9703f792-601f-4f6a-b2f6-74dc78609009 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.078851 Nov 15 12:37:50.568622 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: [pid: 107590|app: 0|req: 38/77] 10.222.0.43 () {60 vars in 1193 bytes} [Mon Nov 15 12:37:50 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:38:48.774147 dv-cinder-680889-10-iscsi devstack@n-api.service[107589]: Mon Nov 15 12:38:48 2021 - graceful shutdown triggered... Nov 15 12:38:48.773899 dv-cinder-680889-10-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 15 12:38:48.775194 dv-cinder-680889-10-iscsi devstack@n-api.service[107590]: Gracefully killing worker 1 (pid: 107590)... Nov 15 12:38:48.775569 dv-cinder-680889-10-iscsi devstack@n-api.service[107591]: Gracefully killing worker 2 (pid: 107591)... Nov 15 12:38:49.774964 dv-cinder-680889-10-iscsi devstack@n-api.service[107589]: worker 1 buried after 1 seconds Nov 15 12:38:49.775539 dv-cinder-680889-10-iscsi devstack@n-api.service[107589]: worker 2 buried after 1 seconds Nov 15 12:38:49.775539 dv-cinder-680889-10-iscsi devstack@n-api.service[107589]: goodbye to uWSGI. Nov 15 12:38:49.776582 dv-cinder-680889-10-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 15 12:38:49.777130 dv-cinder-680889-10-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 15 12:38:49.779911 dv-cinder-680889-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 15 12:38:49.792936 dv-cinder-680889-10-iscsi devstack@n-api.service[122552]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 15 12:38:49.794999 dv-cinder-680889-10-iscsi devstack@n-api.service[122552]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Nov 15 12:38:49 2021] *** Nov 15 12:38:49.794999 dv-cinder-680889-10-iscsi devstack@n-api.service[122552]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 15 12:38:49.794999 dv-cinder-680889-10-iscsi devstack@n-api.service[122552]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 15 12:38:49.794999 dv-cinder-680889-10-iscsi devstack@n-api.service[122552]: nodename: dv-cinder-680889-10-iscsi Nov 15 12:38:49.794999 dv-cinder-680889-10-iscsi devstack@n-api.service[122552]: machine: x86_64 Nov 15 12:38:49.794999 dv-cinder-680889-10-iscsi devstack@n-api.service[122552]: clock source: unix Nov 15 12:38:49.794999 dv-cinder-680889-10-iscsi devstack@n-api.service[122552]: pcre jit disabled Nov 15 12:38:49.794999 dv-cinder-680889-10-iscsi devstack@n-api.service[122552]: detected number of CPU cores: 4 Nov 15 12:38:49.794999 dv-cinder-680889-10-iscsi devstack@n-api.service[122552]: current working directory: / Nov 15 12:38:49.794999 dv-cinder-680889-10-iscsi devstack@n-api.service[122552]: detected binary path: /usr/bin/uwsgi-core Nov 15 12:38:49.795791 dv-cinder-680889-10-iscsi devstack@n-api.service[122552]: your processes number limit is 47680 Nov 15 12:38:49.795791 dv-cinder-680889-10-iscsi devstack@n-api.service[122552]: your memory page size is 4096 bytes Nov 15 12:38:49.795791 dv-cinder-680889-10-iscsi devstack@n-api.service[122552]: detected max file descriptor number: 2048 Nov 15 12:38:49.795791 dv-cinder-680889-10-iscsi devstack@n-api.service[122552]: lock engine: pthread robust mutexes Nov 15 12:38:49.795791 dv-cinder-680889-10-iscsi devstack@n-api.service[122552]: thunder lock: enabled Nov 15 12:38:49.795791 dv-cinder-680889-10-iscsi devstack@n-api.service[122552]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 15 12:38:49.795791 dv-cinder-680889-10-iscsi devstack@n-api.service[122552]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 15 12:38:49.841855 dv-cinder-680889-10-iscsi devstack@n-api.service[122552]: Python main interpreter initialized at 0x56329f4b79c0 Nov 15 12:38:49.842125 dv-cinder-680889-10-iscsi devstack@n-api.service[122552]: python threads support enabled Nov 15 12:38:49.842268 dv-cinder-680889-10-iscsi devstack@n-api.service[122552]: your server socket listen backlog is limited to 100 connections Nov 15 12:38:49.842388 dv-cinder-680889-10-iscsi devstack@n-api.service[122552]: your mercy for graceful operations on workers is 90 seconds Nov 15 12:38:49.842861 dv-cinder-680889-10-iscsi devstack@n-api.service[122552]: mapped 403077 bytes (393 KB) for 2 cores Nov 15 12:38:49.843087 dv-cinder-680889-10-iscsi devstack@n-api.service[122552]: *** Operational MODE: preforking *** Nov 15 12:38:49.843526 dv-cinder-680889-10-iscsi devstack@n-api.service[122552]: *** uWSGI is running in multiple interpreter mode *** Nov 15 12:38:49.843658 dv-cinder-680889-10-iscsi devstack@n-api.service[122552]: spawned uWSGI master process (pid: 122552) Nov 15 12:38:49.843953 dv-cinder-680889-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 15 12:38:49.847105 dv-cinder-680889-10-iscsi devstack@n-api.service[122552]: spawned uWSGI worker 1 (pid: 122567, cores: 1) Nov 15 12:38:49.847105 dv-cinder-680889-10-iscsi devstack@n-api.service[122552]: spawned uWSGI worker 2 (pid: 122568, cores: 1) Nov 15 12:38:49.847105 dv-cinder-680889-10-iscsi devstack@n-api.service[122552]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 15 12:38:51.720867 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 15 12:38:51.720867 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: from cryptography.utils import int_from_bytes Nov 15 12:38:51.721663 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 15 12:38:51.721663 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: from cryptography.utils import int_from_bytes Nov 15 12:38:51.738095 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 15 12:38:51.738095 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: from cryptography.utils import int_from_bytes Nov 15 12:38:51.738802 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 15 12:38:51.738802 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: from cryptography.utils import int_from_bytes Nov 15 12:38:54.099050 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 15 12:38:54.099708 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 15 12:38:54.099835 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 15 12:38:54.100154 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 15 12:38:54.100405 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 15 12:38:54.100846 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.101178 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.101544 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.101871 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.102203 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.102518 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.102983 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.103319 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.103653 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.103914 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.104235 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.104575 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-680889-10-iscsi {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.104894 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.105118 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 15 12:38:54.105504 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.105587 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 15 12:38:54.105672 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.105839 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.105938 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 15 12:38:54.106108 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.106216 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 15 12:38:54.106432 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.106544 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 15 12:38:54.106758 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.106963 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.107193 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.107298 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.108642 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.108752 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.108850 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.109011 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.109144 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.109240 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.109331 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.109432 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.109525 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.109525 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.109685 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.109780 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.109864 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.109948 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.110030 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.110133 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.110215 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.110306 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-680889-10-iscsi {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.110394 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.110504 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.110686 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.110853 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.111147 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.111262 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-680889-10-iscsi {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.111469 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.111588 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.112260 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.112383 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.112599 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.112907 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.113025 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.113346 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.113460 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.113713 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.113859 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.114018 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.114173 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.114320 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.114472 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.114642 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.114737 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.115043 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.115191 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.115284 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.115462 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.115571 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.115785 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.115875 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.116107 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.116218 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.116429 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.116535 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.116734 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.116826 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-680889-10-iscsi {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.117042 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.117146 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.117360 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.117474 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.117682 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.117792 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.118589 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.118853 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.118930 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.119001 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.119084 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.119157 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.119236 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.119305 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.119374 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.119449 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.119610 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.119690 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.119847 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.119997 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.120083 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.120229 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.120307 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.120864 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.120978 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.121063 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.121146 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.121217 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.121291 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.121488 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.121599 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.121754 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.122051 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.122357 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.122634 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.122747 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.122983 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.123092 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.123283 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.123383 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.123602 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.123788 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.123946 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.124039 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.124230 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.124328 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.124537 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.124645 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.124856 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.124961 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.125258 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.125422 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.125584 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.125749 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.125902 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.126044 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.126196 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.126349 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.126508 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.126652 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.126839 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.126991 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.127218 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.127366 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.127366 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.128263 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.128263 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.128560 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.128704 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.128855 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.129009 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.129160 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.129303 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.129455 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.129599 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.129758 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.129913 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.130063 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.130225 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.130376 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.130529 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.130753 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.131007 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.131163 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.131307 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.131458 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.131612 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.131771 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.131930 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.132106 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.132369 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.132532 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.132684 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.132847 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.132998 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.133150 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.133303 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.133454 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.133628 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.133861 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.134009 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.134161 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.134305 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.134448 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.134618 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.134764 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.134934 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.135084 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.135248 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.135488 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.135648 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.135800 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.135951 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.136121 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.136270 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.136270 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.136564 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.136720 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.136865 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.137017 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.137169 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.137329 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.137329 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.137329 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.137777 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.137931 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.138084 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.138229 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.138371 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.138513 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.138682 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.138844 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.139005 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.139150 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.139299 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.139449 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.139602 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.139755 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.139908 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.140060 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.140204 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.140368 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.140535 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.140679 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.142124 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.142295 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.142574 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.142574 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.142963 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.143066 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.143160 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.143238 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.143374 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.143499 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.143601 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.143695 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.143922 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.144015 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.144015 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.144015 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.144015 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.144318 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.144628 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.144756 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.144885 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.145006 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.145137 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.145278 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.145410 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.145646 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.145765 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.145883 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.145997 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.146123 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.146237 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.146992 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.147192 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.147320 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.147320 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.147592 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.147680 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.147763 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.147852 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.147944 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.148070 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.148171 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.148381 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.148482 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.148704 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.148807 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.149016 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.149119 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.149327 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.149420 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.149635 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.149738 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.149944 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.150044 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.150251 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.150343 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.150558 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.150712 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.150943 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.151088 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.151225 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.151362 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.151467 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.151562 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.151780 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.151880 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.152102 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.152194 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.152412 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.152516 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.152779 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.152923 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.153063 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.153154 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.153379 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 15 12:38:54.153485 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.153704 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.153796 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.154016 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.154108 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.154360 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.154509 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.154676 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.154853 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.155028 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.155150 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.155355 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.155460 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.155668 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.155761 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.155976 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.156067 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.156286 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.156385 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.156601 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.156700 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.156908 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.156998 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.157218 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.157325 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.157528 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.157630 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.157837 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.157940 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.158151 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.158243 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.158473 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.158563 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.158847 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.158966 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.159162 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.159484 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.159576 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.159720 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.159820 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.159914 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.160062 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.160184 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.160368 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.160511 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.160689 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.160837 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.161015 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.161163 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.161323 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.161473 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.161657 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.161811 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.161964 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.162124 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.162275 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.162457 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.162601 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.162824 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.162967 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.163121 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.163341 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.163452 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.163589 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.163736 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.163832 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.164147 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.164254 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.164418 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.164523 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.164689 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.164799 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.165004 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.165118 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.165307 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.165415 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.165613 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.165722 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.165926 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.166021 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.166239 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.166342 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.166543 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.166643 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.166875 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.166982 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.167188 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.167302 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.167500 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.167648 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.167801 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.167942 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.168122 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.168217 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.168429 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.168525 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.168745 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.168834 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.169052 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.169157 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.169363 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.169463 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.169672 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.169773 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.169978 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.170072 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.170284 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.170382 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.170590 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.170695 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.170919 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.171023 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.171244 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.171387 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.171555 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.171673 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.171857 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.171949 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.172161 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.172253 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.172465 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.172565 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.172770 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.172901 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.173071 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.173161 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.173385 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.173559 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.173703 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.173852 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.174000 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.174148 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.175209 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.175374 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.175475 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.175817 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.176076 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.176414 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.176753 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.177161 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.177290 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.177688 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.178103 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.178227 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.178349 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.178349 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.178567 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.178686 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.179030 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.179455 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.179622 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.179774 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.180016 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.180195 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.180346 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.180507 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.180667 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.180826 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.180982 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.180982 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.181382 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.181636 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.181636 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.181935 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.182084 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.182232 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.182389 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.182549 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.182818 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.182818 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.183514 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.183671 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.183837 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.184007 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.184007 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.184186 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.184325 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.184425 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.184715 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.185029 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.185145 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.185343 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.185552 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.185704 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.186024 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.186125 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.186378 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.186698 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.186818 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.187065 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.187397 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.187514 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.187734 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.188040 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.188248 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.188342 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.188658 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.188914 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.189005 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.189278 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.189515 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.189770 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.190686 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.190862 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.191026 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.191345 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.191609 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.191739 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.191979 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.192344 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.192504 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.192596 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.192886 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.193028 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.193234 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.193499 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.193606 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.193880 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.194186 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.194302 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.194504 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.194814 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.198843 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.198975 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.199067 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.199067 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.199239 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.199311 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.199311 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.199311 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.199311 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.199563 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.199634 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.199634 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.199765 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.200385 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.200385 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.200545 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.200771 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.200771 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.200771 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.201514 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.201596 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.201596 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.201596 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.201596 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.201596 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.201926 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.202003 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.202003 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.202143 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.202359 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.202453 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.202538 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.202538 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.202692 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.203300 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.203300 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.203631 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.203778 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.203918 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.204047 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.204175 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.204331 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.204503 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.204635 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.204723 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.204806 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.204934 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.205121 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.205317 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.205475 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.205643 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.205784 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.205937 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.206076 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.206230 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.206384 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.206548 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.206689 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.206869 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.206982 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.207161 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.207256 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.207470 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.207612 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.207795 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.207940 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.208109 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.208240 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.208418 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.208546 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.208725 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.208855 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.209031 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.209153 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.209361 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.209480 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.209679 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.209810 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.209970 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.210098 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.210279 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.210398 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.210589 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.210717 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.210921 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.211053 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.211244 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.211389 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.211557 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.211700 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.211881 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.212100 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.212233 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.212364 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.212504 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.212636 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.212772 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.212909 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.213047 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.213186 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.213513 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.213659 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.213932 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.214165 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.214307 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.214449 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.214584 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.214723 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.214835 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.214919 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.215015 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.215110 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.215194 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.215328 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.215480 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.215582 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.215788 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.215898 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.216102 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.216203 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.216495 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.216687 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.216808 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.217023 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.217118 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.217342 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.217445 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.217662 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.217764 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.217983 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.218284 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.218387 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.218615 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.218705 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.218963 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.219130 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.219292 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.219454 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.219624 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.219764 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.219949 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.220074 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.220339 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.220446 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.220673 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.220774 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.220981 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.221337 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.221682 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.221856 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.222037 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.222298 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.222457 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.222604 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.222812 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.222977 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.223124 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.223278 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.223437 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.223756 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.224043 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.224230 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.224486 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.224638 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.224791 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.224973 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.225075 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.225168 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.225252 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.225341 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.225432 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.225574 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.225811 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.226195 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.226334 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.226568 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.226810 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.226937 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.227132 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.227255 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.227452 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.227534 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.227808 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.227905 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.228120 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.228217 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.228429 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.228531 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.228737 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.228830 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.229046 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.229152 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.229394 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.229540 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.229707 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.229800 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.230031 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.230176 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.230339 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.230442 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.230647 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.230739 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.230996 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.231221 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.231332 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.231540 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.231632 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.231903 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.232009 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.232212 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.232379 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.232522 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.232616 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.232832 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.232933 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.233144 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.233246 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.233454 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.233545 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.233766 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.233914 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.234073 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.234217 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.234382 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.234501 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.234691 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.234851 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.235028 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.235138 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.235329 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.235421 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.235654 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.235743 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.235945 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.236045 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.236251 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.236351 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.236560 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.236662 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.237408 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.237528 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.237806 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.237983 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.238138 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.238322 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.238555 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.238665 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.238751 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.238906 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.239054 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.239164 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.239366 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.239466 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.239674 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.239766 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.240000 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.240108 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.240315 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.240407 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.240623 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.240714 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.240923 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.241023 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.241230 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.241320 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.241533 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.241624 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.241837 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.241952 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.242151 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.242261 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.242455 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.242574 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.242804 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.242924 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.243095 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.243204 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.243401 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.243493 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.243704 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.243803 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.244017 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.244191 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.244329 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.244470 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.244630 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.244805 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.244955 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.245098 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.245249 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.245400 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.245620 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.245764 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.245940 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.246075 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.246217 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.246377 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.246525 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.246638 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.246724 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.246834 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.246984 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.247103 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.247293 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.247391 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.247594 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.247706 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.247897 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.248011 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.248224 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.248325 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.248578 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.248679 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.248884 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.249034 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.249203 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.249523 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.249621 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.249832 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.249939 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.250140 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.250454 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.253251 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.253358 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.253437 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.253520 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.253592 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.253698 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.253954 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.254067 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.254156 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.254156 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.254431 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.254431 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.254595 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.254684 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.254932 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.255044 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.255137 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.255227 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.255227 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.255386 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.255467 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.255560 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.255650 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.255731 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.255731 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.255887 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.255887 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.256068 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.256159 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.256249 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.256338 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.256433 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.256611 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.256873 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.257034 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.257183 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.257339 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.257485 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.257639 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.257791 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.258066 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.258219 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.258363 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.258508 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.258661 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.258842 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.258993 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.259150 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.259303 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.259464 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.259618 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.259772 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.259916 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.260077 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.260223 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.260376 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.260521 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.260665 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.260808 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.260951 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.261101 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.261260 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.261412 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.261566 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.261717 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.261869 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.262128 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.262473 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.262473 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.262911 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.263066 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.263210 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.263363 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.263509 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.263653 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.263795 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.263938 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.264081 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.264264 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.264664 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.264854 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.265014 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.265160 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.265303 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.265462 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.265606 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.265750 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.265893 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.266038 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.266181 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.266338 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.266495 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.266728 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.266947 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.267093 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.267250 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.267403 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.267548 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.267691 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.267920 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.268183 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.268350 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.268498 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.269229 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.269229 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.269542 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.269697 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.269853 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.269999 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.270143 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.270143 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.270418 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.270418 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.270701 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.270701 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.271015 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.271173 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.271316 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.271470 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.271629 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.271773 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.271917 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.272062 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.272212 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.272390 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.272712 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.272885 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.273119 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.273272 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.273435 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.273590 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.273735 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.273878 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.274021 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.274172 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.274316 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.274486 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.274805 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.274805 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.275111 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.275258 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.275415 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.275576 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.275721 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.275872 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.276024 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.276175 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.276330 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.276474 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.276626 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.276872 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.277031 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.277184 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.277414 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.277569 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.277733 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.277733 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.278010 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.278181 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.278423 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.278574 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.278719 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.278904 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.279063 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.279361 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.279547 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.279729 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.279930 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.279930 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.280303 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.280499 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.280680 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.280869 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.280869 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.280869 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.281381 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.281537 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.281683 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.281826 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.281969 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.282132 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.282286 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.282430 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.282592 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.282909 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.283056 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.283310 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.283461 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.283644 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.283882 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.284062 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.284209 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.284370 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.284719 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.285036 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.285198 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.285345 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.285498 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.285643 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.285787 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.285931 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.286084 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.286235 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.286388 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.286542 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.286694 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.286960 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.286960 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.287261 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.287416 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.287561 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.287712 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.287868 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.288013 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.288179 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.288339 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.288578 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.288738 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.288897 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.289042 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.289201 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.289346 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.289490 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.289634 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.289778 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.289928 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.290084 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.290239 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.290384 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.290535 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.290679 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.290915 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.291082 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.291228 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.291372 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.291523 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.291675 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.291819 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.291985 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.292131 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.292275 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.292426 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.292606 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.292932 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.293102 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.293250 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.293492 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.293651 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.293796 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.293955 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.294108 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.294260 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.294411 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.294563 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.294715 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.294976 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.295294 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.295442 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.295594 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.295757 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.296010 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.296186 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.296343 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.296488 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.296632 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.296783 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.296964 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.297182 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.297344 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.297508 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.297654 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.297815 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.297971 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.298124 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.298277 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.298421 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.298585 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.298817 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.298988 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.299143 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.299808 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.300024 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.300238 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.300387 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.300789 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.300940 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.301084 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.301228 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.301372 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.301602 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.301749 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.301893 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.302048 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.302193 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.302345 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.302515 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.302661 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.302823 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.303146 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.303299 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.303442 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.303693 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.303852 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.304007 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.304160 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.304160 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.304442 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.304609 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.304754 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.304905 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.305049 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.305359 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.305521 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.305521 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.305807 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.305958 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.306110 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.306262 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.306419 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.306571 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.306735 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.306939 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.307088 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.307327 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.307491 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.307644 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.307805 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.307954 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.308105 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.308259 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.308417 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.308571 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.308735 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.308975 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.309135 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.309289 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.309442 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.309587 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.309731 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.309882 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.310035 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.310192 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.310337 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.310488 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.310655 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.310822 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.310991 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.311139 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.311283 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.311439 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.311584 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.311728 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.311884 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.312037 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.312181 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.312333 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.312476 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.312634 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.312634 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.312971 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.313293 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.313455 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.313602 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.313848 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.314009 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.314155 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.314298 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.314450 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.314603 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.314786 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.315040 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.315831 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.316159 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.316311 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.316311 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.316601 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.316911 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.317082 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.317243 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.317488 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.317655 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.317820 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.317977 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.318132 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.318279 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.318424 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.318581 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.318581 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.318904 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.319149 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.319314 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.319470 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.319615 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.319771 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.319915 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.320059 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.320209 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.320364 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.320510 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.320661 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.320805 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.320949 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.321100 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.321259 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.321540 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.321706 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.321866 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.321866 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.322149 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.322317 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.322464 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.322607 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.322751 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.323003 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.323167 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.323487 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.323649 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.323813 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.324050 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.324201 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.324355 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.324502 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.324646 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.324790 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.324942 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.325087 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.325259 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.325608 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.325930 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.326085 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.326237 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.326404 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.326551 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.326696 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.326922 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.327073 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.327224 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.327378 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.327612 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.327765 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.327929 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.328076 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.328229 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.328422 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.328581 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.328736 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.328736 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.329092 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.329342 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.329503 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.329648 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.329794 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.329945 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.330092 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.330244 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.330389 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.330579 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.330737 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.330968 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.331154 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.331355 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.331504 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.331648 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.331794 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.331946 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.332091 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.332248 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.332394 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.332538 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.332699 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.332846 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.332998 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.333156 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.333301 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.333623 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.333781 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.333927 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.334103 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.334325 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.334552 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.334706 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.334879 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.335050 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.335211 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.335364 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.335510 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.335662 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.335807 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.336119 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.336351 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.336499 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.336643 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.336787 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.336938 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.337084 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.337254 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.337408 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.337553 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.337794 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.337946 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.338102 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.338248 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.338400 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.338545 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.338697 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.338922 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.338922 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.339218 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.339461 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.339612 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.339757 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.339908 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.340072 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.340072 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.340355 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.340516 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.340668 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.340828 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.340990 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.341150 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.341314 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.341466 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.341616 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.341776 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.341928 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.342079 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.342237 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.342398 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.342550 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.342830 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.343007 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.343162 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.343313 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.343477 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.343800 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.343800 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.344204 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.344461 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.344461 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.344766 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.344930 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.345100 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.345254 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.345416 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.345578 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.345752 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.345915 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.346328 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.346567 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.346797 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.346994 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.347216 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.347391 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.347548 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.347700 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.347954 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.348114 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.348277 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.348452 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.348607 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.348759 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.348911 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.349074 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.349236 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.349389 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.349637 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.349806 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.349963 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.350124 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.350290 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.350464 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.350618 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.350804 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.350966 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.351119 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.351289 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.351289 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.351590 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.351753 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.351906 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.352066 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.352229 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.352390 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.352554 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.352713 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.352877 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.353039 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.353193 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.353353 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.353507 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.353658 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.354014 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.354188 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.354352 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.354613 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.354805 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.354978 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.355133 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.355133 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.355445 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.355598 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.355750 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.355903 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.356109 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.356483 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.356653 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.356816 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.356972 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.357169 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.357338 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.357493 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.357668 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.357879 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.358316 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.358490 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.358656 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.358994 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.359165 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.359402 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.359568 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.359875 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.360051 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.360214 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.360376 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.360530 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.360684 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.360886 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.361043 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.361320 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.361497 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.361653 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.362399 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.362665 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.363057 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.363241 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.363411 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.363574 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.363748 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.363931 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.364324 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.364488 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.364784 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.365018 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.365199 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.365366 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.365534 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.365686 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.365839 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.365999 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.366162 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.366316 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.366713 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.366955 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.367111 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.367262 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.367436 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.367602 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.367764 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.367928 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.368091 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.368270 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.368536 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.368694 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.368847 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.369007 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.369168 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.369334 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.369501 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.369656 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.369834 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.370107 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.370265 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.370427 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.370581 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.370733 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.370987 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.371142 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.371309 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.371471 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.371624 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.371777 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.371929 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.372080 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.372252 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.372415 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.372576 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.372738 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.372891 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.373042 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.373207 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.373361 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.373519 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.373678 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.373846 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.374013 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 15 12:38:54.374305 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.374305 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.374305 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.374305 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.374305 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.374305 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.374305 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.374305 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.375747 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.375747 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.375747 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.375747 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.375747 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 15 12:38:54.375747 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 15 12:38:54.386322 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_db.sqlalchemy.engines [None req-b85eeb5e-15fd-4aba-af8d-3180fc223696 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122567) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 15 12:38:54.391296 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_db.sqlalchemy.engines [None req-69e42250-8c2d-4a60-937a-0a18d24eefa7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122568) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 15 12:38:54.555010 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.context [None req-b85eeb5e-15fd-4aba-af8d-3180fc223696 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),388e2b35-2c0f-43c3-b3c8-e061c392ccce(cell1) {{(pid=122567) load_cells /opt/stack/nova/nova/context.py:464}} Nov 15 12:38:54.558911 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.context [None req-69e42250-8c2d-4a60-937a-0a18d24eefa7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),388e2b35-2c0f-43c3-b3c8-e061c392ccce(cell1) {{(pid=122568) load_cells /opt/stack/nova/nova/context.py:464}} Nov 15 12:38:54.559493 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b85eeb5e-15fd-4aba-af8d-3180fc223696 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:38:54.561589 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b85eeb5e-15fd-4aba-af8d-3180fc223696 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:38:54.562467 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b85eeb5e-15fd-4aba-af8d-3180fc223696 None None] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:38:54.564655 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-69e42250-8c2d-4a60-937a-0a18d24eefa7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:38:54.564804 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b85eeb5e-15fd-4aba-af8d-3180fc223696 None None] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:38:54.566271 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-69e42250-8c2d-4a60-937a-0a18d24eefa7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:38:54.567082 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-69e42250-8c2d-4a60-937a-0a18d24eefa7 None None] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:38:54.569046 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-69e42250-8c2d-4a60-937a-0a18d24eefa7 None None] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:38:54.575645 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_db.sqlalchemy.engines [None req-b85eeb5e-15fd-4aba-af8d-3180fc223696 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122567) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 15 12:38:54.577822 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_db.sqlalchemy.engines [None req-b85eeb5e-15fd-4aba-af8d-3180fc223696 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122567) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 15 12:38:54.582535 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_db.sqlalchemy.engines [None req-69e42250-8c2d-4a60-937a-0a18d24eefa7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122568) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 15 12:38:54.583558 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_db.sqlalchemy.engines [None req-69e42250-8c2d-4a60-937a-0a18d24eefa7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122568) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 15 12:38:54.742860 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_db.sqlalchemy.engines [None req-b85eeb5e-15fd-4aba-af8d-3180fc223696 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122567) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 15 12:38:54.755071 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_db.sqlalchemy.engines [None req-69e42250-8c2d-4a60-937a-0a18d24eefa7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122568) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 15 12:38:55.073791 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: WARNING keystonemiddleware.auth_token [None req-b85eeb5e-15fd-4aba-af8d-3180fc223696 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 15 12:38:55.080404 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: WARNING keystonemiddleware.auth_token [None req-b85eeb5e-15fd-4aba-af8d-3180fc223696 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 15 12:38:55.100149 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: WARNING keystonemiddleware.auth_token [None req-69e42250-8c2d-4a60-937a-0a18d24eefa7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 15 12:38:55.106687 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: WARNING keystonemiddleware.auth_token [None req-69e42250-8c2d-4a60-937a-0a18d24eefa7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 15 12:38:55.429420 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: WARNING keystonemiddleware.auth_token [None req-b85eeb5e-15fd-4aba-af8d-3180fc223696 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 15 12:38:55.435575 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: WARNING keystonemiddleware.auth_token [None req-b85eeb5e-15fd-4aba-af8d-3180fc223696 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 15 12:38:55.441464 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56329f4b79c0 pid: 122567 (default app) Nov 15 12:38:55.494248 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: WARNING keystonemiddleware.auth_token [None req-69e42250-8c2d-4a60-937a-0a18d24eefa7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 15 12:38:55.499521 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: WARNING keystonemiddleware.auth_token [None req-69e42250-8c2d-4a60-937a-0a18d24eefa7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 15 12:38:55.504982 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56329f4b79c0 pid: 122568 (default app) Nov 15 12:39:32.197021 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-bd06b961-e942-413b-9d3a-8bbde155a284 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] Action: 'create', calling method: .version_select at 0x7f1321289dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1847026390"}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:39:33.440216 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-0078e0c6-6951-44b8-b6cd-73ca7866a4f7 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1846461834", "imageRef": "3cc21e2c-27da-4266-be76-369023341c16", "flavorRef": "452", "networks": [{"uuid": "9dd72df4-58d1-4d00-beca-5f4ede5007f7"}]}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:39:33.929544 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.network.neutron [None req-0078e0c6-6951-44b8-b6cd-73ca7866a4f7 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] validate_networks() for [('9dd72df4-58d1-4d00-beca-5f4ede5007f7', None, None, None, None, None)] {{(pid=122568) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 15 12:39:34.762466 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-bd06b961-e942-413b-9d3a-8bbde155a284 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.606780 Nov 15 12:39:34.763770 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 1/1] 10.222.0.43 () {60 vars in 1154 bytes} [Mon Nov 15 12:39:30 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 4610 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 15 12:39:34.776693 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-48619773-441a-46a3-bdf5-a976a748e683 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] Calling method '.version_select at 0x7f13210db940>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:34.907079 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-48619773-441a-46a3-bdf5-a976a748e683 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/9ddc24b9-5708-4d3c-80ee-e67d1bac2771" status: 200 len: 345 microversion: 2.1 time: 0.134694 Nov 15 12:39:34.908596 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 2/2] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Nov 15 12:39:34 2021] GET /compute/v2.1/os-volumes/9ddc24b9-5708-4d3c-80ee-e67d1bac2771 => generated 345 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:39:35.682622 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-0078e0c6-6951-44b8-b6cd-73ca7866a4f7 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Flavor limits 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 15 12:39:35.683348 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-0078e0c6-6951-44b8-b6cd-73ca7866a4f7 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Image limits 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 15 12:39:35.684038 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-0078e0c6-6951-44b8-b6cd-73ca7866a4f7 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Flavor pref 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 15 12:39:35.684704 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-0078e0c6-6951-44b8-b6cd-73ca7866a4f7 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Image pref 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 15 12:39:35.685287 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-0078e0c6-6951-44b8-b6cd-73ca7866a4f7 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 15 12:39:35.715086 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0078e0c6-6951-44b8-b6cd-73ca7866a4f7 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:35.715524 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0078e0c6-6951-44b8-b6cd-73ca7866a4f7 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:35.716382 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0078e0c6-6951-44b8-b6cd-73ca7866a4f7 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:35.719042 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0078e0c6-6951-44b8-b6cd-73ca7866a4f7 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:35.796232 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-0078e0c6-6951-44b8-b6cd-73ca7866a4f7 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Getting quotas for project 53c643bbc1074232958965e5aceb5e5b. Resources: {'cores', 'ram', 'instances'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:39:35.813657 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-0078e0c6-6951-44b8-b6cd-73ca7866a4f7 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Getting quotas for user 9dbc2c70765e4a2b8ac3974676ed1eea and project 53c643bbc1074232958965e5aceb5e5b. Resources: {'cores', 'ram', 'instances'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:39:35.844205 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-0078e0c6-6951-44b8-b6cd-73ca7866a4f7 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Going to run 1 instances... {{(pid=122568) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 15 12:39:35.853491 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-0078e0c6-6951-44b8-b6cd-73ca7866a4f7 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3cc21e2c-27da-4266-be76-369023341c16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 15 12:39:35.924805 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-a4797649-3745-4ffc-bced-c9735f825f0a tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] Calling method '.version_select at 0x7f13210dbe50>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:36.010224 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-a4797649-3745-4ffc-bced-c9735f825f0a tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/9ddc24b9-5708-4d3c-80ee-e67d1bac2771" status: 200 len: 346 microversion: 2.1 time: 0.090252 Nov 15 12:39:36.011552 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 3/3] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Nov 15 12:39:35 2021] GET /compute/v2.1/os-volumes/9ddc24b9-5708-4d3c-80ee-e67d1bac2771 => generated 346 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:39:36.023960 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-98d3e928-97d9-4e7b-9aeb-75700b1f9d8d tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] Action: 'create', calling method: .version_select at 0x7f13210ec310>, body: {"snapshot": {"volume_id": "9ddc24b9-5708-4d3c-80ee-e67d1bac2771", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-833907744"}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:39:36.036523 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-0078e0c6-6951-44b8-b6cd-73ca7866a4f7 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.895741 Nov 15 12:39:36.043034 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 1/4] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Nov 15 12:39:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 3906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 15 12:39:36.050005 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-3d885279-f448-4edf-a0a7-e5df8fa7b6ae tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:36.051229 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-3d885279-f448-4edf-a0a7-e5df8fa7b6ae tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:36.354459 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-3d885279-f448-4edf-a0a7-e5df8fa7b6ae tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:36.399080 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-3d885279-f448-4edf-a0a7-e5df8fa7b6ae tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1215 microversion: 2.1 time: 0.352128 Nov 15 12:39:36.413492 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 2/5] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:36 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1215 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:39:36.446172 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-98d3e928-97d9-4e7b-9aeb-75700b1f9d8d tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] 10.222.0.43 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.427132 Nov 15 12:39:36.447714 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 4/6] 10.222.0.43 () {60 vars in 1161 bytes} [Mon Nov 15 12:39:36 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 15 12:39:36.459721 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-6c97366b-c382-4481-870b-de0b2762e9d3 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] Calling method '.version_select at 0x7f1321087e50>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:36.582724 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-6c97366b-c382-4481-870b-de0b2762e9d3 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/9a6cdd1c-1dd7-426c-b487-a6cfb8d9ff5e" status: 200 len: 286 microversion: 2.1 time: 0.129190 Nov 15 12:39:36.589502 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 3/7] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Nov 15 12:39:36 2021] GET /compute/v2.1/os-snapshots/9a6cdd1c-1dd7-426c-b487-a6cfb8d9ff5e => generated 286 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:39:36.593396 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-94a7c571-81be-4658-8c98-06b90c357a30 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] Calling method '.version_select at 0x7f13210ece50>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:36.703500 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-94a7c571-81be-4658-8c98-06b90c357a30 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.113514 Nov 15 12:39:36.705051 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 5/8] 10.222.0.43 () {58 vars in 1139 bytes} [Mon Nov 15 12:39:36 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 15 12:39:36.718582 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-fbdf6c4e-10af-4d50-807c-1c35e007c58c tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] Calling method '.version_select at 0x7f131bfc3310>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:36.784638 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-fbdf6c4e-10af-4d50-807c-1c35e007c58c tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/9a6cdd1c-1dd7-426c-b487-a6cfb8d9ff5e" status: 200 len: 286 microversion: 2.1 time: 0.071553 Nov 15 12:39:36.786034 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 4/9] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Nov 15 12:39:36 2021] GET /compute/v2.1/os-snapshots/9a6cdd1c-1dd7-426c-b487-a6cfb8d9ff5e => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:39:37.418925 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-40874b55-1ee0-43db-87ce-4195ba889229 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:37.419758 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-40874b55-1ee0-43db-87ce-4195ba889229 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:37.607390 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-40874b55-1ee0-43db-87ce-4195ba889229 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:37.629450 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-40874b55-1ee0-43db-87ce-4195ba889229 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1215 microversion: 2.1 time: 0.214339 Nov 15 12:39:37.633698 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 6/10] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:37 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1215 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:39:37.799168 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-4762c2d1-abee-41ac-9ec9-e878fbeb467a tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] Calling method '.version_select at 0x7f131bf8fca0>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:37.855226 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-4762c2d1-abee-41ac-9ec9-e878fbeb467a tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/9a6cdd1c-1dd7-426c-b487-a6cfb8d9ff5e" status: 200 len: 286 microversion: 2.1 time: 0.061643 Nov 15 12:39:37.856580 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 5/11] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Nov 15 12:39:37 2021] GET /compute/v2.1/os-snapshots/9a6cdd1c-1dd7-426c-b487-a6cfb8d9ff5e => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:39:38.651682 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-0cd0bea9-4e0f-4e86-ade6-e8ad8bec4714 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:38.652444 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-0cd0bea9-4e0f-4e86-ade6-e8ad8bec4714 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:38.665438 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0cd0bea9-4e0f-4e86-ade6-e8ad8bec4714 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:38.665895 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0cd0bea9-4e0f-4e86-ade6-e8ad8bec4714 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:38.666709 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0cd0bea9-4e0f-4e86-ade6-e8ad8bec4714 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:38.667224 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0cd0bea9-4e0f-4e86-ade6-e8ad8bec4714 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:38.868335 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-195454ae-424a-48c3-ae7f-7153e99e2613 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] Calling method '.version_select at 0x7f131bf8fc10>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:38.939191 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-195454ae-424a-48c3-ae7f-7153e99e2613 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/9a6cdd1c-1dd7-426c-b487-a6cfb8d9ff5e" status: 200 len: 286 microversion: 2.1 time: 0.073814 Nov 15 12:39:38.944352 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 6/12] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Nov 15 12:39:38 2021] GET /compute/v2.1/os-snapshots/9a6cdd1c-1dd7-426c-b487-a6cfb8d9ff5e => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:39:38.965236 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-0cd0bea9-4e0f-4e86-ade6-e8ad8bec4714 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:38.992926 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-0cd0bea9-4e0f-4e86-ade6-e8ad8bec4714 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1219 microversion: 2.1 time: 0.344295 Nov 15 12:39:38.995936 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 7/13] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:38 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1219 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:39:39.951362 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-81e43490-43c4-4d23-8513-b7587269c1fa tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] Calling method '.version_select at 0x7f131bf9d040>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:40.006066 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-81e43490-43c4-4d23-8513-b7587269c1fa tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/9a6cdd1c-1dd7-426c-b487-a6cfb8d9ff5e" status: 200 len: 286 microversion: 2.1 time: 0.056685 Nov 15 12:39:40.019443 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 7/14] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Nov 15 12:39:39 2021] GET /compute/v2.1/os-snapshots/9a6cdd1c-1dd7-426c-b487-a6cfb8d9ff5e => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:39:40.020120 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-d90124c4-f551-445c-8658-11081d4502d5 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:40.022348 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-d90124c4-f551-445c-8658-11081d4502d5 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:40.035385 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d90124c4-f551-445c-8658-11081d4502d5 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:40.043208 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d90124c4-f551-445c-8658-11081d4502d5 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:40.044599 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d90124c4-f551-445c-8658-11081d4502d5 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:40.050782 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d90124c4-f551-445c-8658-11081d4502d5 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:40.248711 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-d90124c4-f551-445c-8658-11081d4502d5 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:40.266645 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-d90124c4-f551-445c-8658-11081d4502d5 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1211 microversion: 2.1 time: 0.259023 Nov 15 12:39:40.280257 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 8/15] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:40 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1211 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:39:40.917111 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-4b5c95b4-a83e-4000-99b5-97e9c88790e3 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'create', calling method: .version_select at 0x7f13211fa790>, body: {"keypair": {"name": "tempest-keypair-954062943"}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:39:40.959972 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-4b5c95b4-a83e-4000-99b5-97e9c88790e3 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Getting quotas for project b91bd39e4f3b40f396370b06f870aeb6. Resources: {'key_pairs'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:39:40.976979 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-4b5c95b4-a83e-4000-99b5-97e9c88790e3 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Getting quotas for user 1f4fb2fdbe754d13af2222261fddbbdc and project b91bd39e4f3b40f396370b06f870aeb6. Resources: {'key_pairs'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:39:41.027308 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-7ae70e4c-8662-413b-bdd2-ec0da974e617 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] Calling method '.version_select at 0x7f1321045670>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:41.103762 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-7ae70e4c-8662-413b-bdd2-ec0da974e617 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/9a6cdd1c-1dd7-426c-b487-a6cfb8d9ff5e" status: 200 len: 286 microversion: 2.1 time: 0.080822 Nov 15 12:39:41.105069 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 9/16] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Nov 15 12:39:41 2021] GET /compute/v2.1/os-snapshots/9a6cdd1c-1dd7-426c-b487-a6cfb8d9ff5e => generated 286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:39:41.287930 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-1a393af5-878d-4758-a41c-cecb5326d51e tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:41.290446 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-1a393af5-878d-4758-a41c-cecb5326d51e tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:41.316127 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1a393af5-878d-4758-a41c-cecb5326d51e tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:41.320570 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1a393af5-878d-4758-a41c-cecb5326d51e tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:41.322717 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1a393af5-878d-4758-a41c-cecb5326d51e tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:41.327300 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1a393af5-878d-4758-a41c-cecb5326d51e tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:41.405170 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-4b5c95b4-a83e-4000-99b5-97e9c88790e3 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Getting quotas for project b91bd39e4f3b40f396370b06f870aeb6. Resources: {'key_pairs'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:39:41.418374 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-4b5c95b4-a83e-4000-99b5-97e9c88790e3 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Getting quotas for user 1f4fb2fdbe754d13af2222261fddbbdc and project b91bd39e4f3b40f396370b06f870aeb6. Resources: {'key_pairs'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:39:41.484802 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-4b5c95b4-a83e-4000-99b5-97e9c88790e3 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.810319 Nov 15 12:39:41.485648 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 8/17] 10.222.0.43 () {60 vars in 1157 bytes} [Mon Nov 15 12:39:40 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:39:41.596727 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-1a393af5-878d-4758-a41c-cecb5326d51e tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:41.611577 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-1a393af5-878d-4758-a41c-cecb5326d51e tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1211 microversion: 2.1 time: 0.324149 Nov 15 12:39:41.613278 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 10/18] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:41 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1211 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:39:41.759702 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-488954e4-f57f-4652-8ef0-8b5c2d8b9451 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1748382021", "imageRef": "3cc21e2c-27da-4266-be76-369023341c16", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d1a2a422-953b-42b1-8d45-4652cac485ba"}]}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:39:41.901537 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.network.neutron [None req-488954e4-f57f-4652-8ef0-8b5c2d8b9451 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] validate_networks() for [('d1a2a422-953b-42b1-8d45-4652cac485ba', None, None, None, None, None)] {{(pid=122568) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 15 12:39:42.116732 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-ca2c83ef-0a8f-46e8-a34f-62e06890870e tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] Calling method '.version_select at 0x7f132102aaf0>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:42.234592 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-ca2c83ef-0a8f-46e8-a34f-62e06890870e tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/9a6cdd1c-1dd7-426c-b487-a6cfb8d9ff5e" status: 200 len: 286 microversion: 2.1 time: 0.121690 Nov 15 12:39:42.235189 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 11/19] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Nov 15 12:39:42 2021] GET /compute/v2.1/os-snapshots/9a6cdd1c-1dd7-426c-b487-a6cfb8d9ff5e => generated 286 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:39:42.630697 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e88dbcb1-585a-49fc-9cd1-efa93b63c3be tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:42.631539 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e88dbcb1-585a-49fc-9cd1-efa93b63c3be tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:42.643656 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e88dbcb1-585a-49fc-9cd1-efa93b63c3be tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:42.645007 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e88dbcb1-585a-49fc-9cd1-efa93b63c3be tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:42.646030 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e88dbcb1-585a-49fc-9cd1-efa93b63c3be tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:42.646610 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e88dbcb1-585a-49fc-9cd1-efa93b63c3be tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:42.654165 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-488954e4-f57f-4652-8ef0-8b5c2d8b9451 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Flavor limits 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 15 12:39:42.655198 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-488954e4-f57f-4652-8ef0-8b5c2d8b9451 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Image limits 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 15 12:39:42.655997 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-488954e4-f57f-4652-8ef0-8b5c2d8b9451 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Flavor pref 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 15 12:39:42.656592 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-488954e4-f57f-4652-8ef0-8b5c2d8b9451 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Image pref 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 15 12:39:42.657182 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-488954e4-f57f-4652-8ef0-8b5c2d8b9451 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 15 12:39:42.677935 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-488954e4-f57f-4652-8ef0-8b5c2d8b9451 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:42.679090 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-488954e4-f57f-4652-8ef0-8b5c2d8b9451 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:42.687717 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-488954e4-f57f-4652-8ef0-8b5c2d8b9451 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:42.688170 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-488954e4-f57f-4652-8ef0-8b5c2d8b9451 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:42.761684 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-488954e4-f57f-4652-8ef0-8b5c2d8b9451 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Getting quotas for project 66b782e267fb414c9bdfa078a438871a. Resources: {'cores', 'ram', 'instances'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:39:42.773396 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-488954e4-f57f-4652-8ef0-8b5c2d8b9451 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Getting quotas for user c77087092d5b44e0b865de65e33e12bd and project 66b782e267fb414c9bdfa078a438871a. Resources: {'cores', 'ram', 'instances'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:39:42.807734 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-488954e4-f57f-4652-8ef0-8b5c2d8b9451 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Going to run 1 instances... {{(pid=122568) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 15 12:39:42.809964 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-488954e4-f57f-4652-8ef0-8b5c2d8b9451 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3cc21e2c-27da-4266-be76-369023341c16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 15 12:39:42.837471 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e88dbcb1-585a-49fc-9cd1-efa93b63c3be tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:42.853944 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e88dbcb1-585a-49fc-9cd1-efa93b63c3be tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1211 microversion: 2.1 time: 0.228019 Nov 15 12:39:42.857319 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 12/20] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:42 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1211 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:39:42.937136 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-488954e4-f57f-4652-8ef0-8b5c2d8b9451 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.425822 Nov 15 12:39:42.940225 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 9/21] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Nov 15 12:39:41 2021] POST /compute/v2.1/servers => generated 383 bytes in 1431 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 15 12:39:42.949855 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-aa947ece-6d3c-4df4-8e17-537e200fc104 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:42.950629 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-aa947ece-6d3c-4df4-8e17-537e200fc104 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:43.083317 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-aa947ece-6d3c-4df4-8e17-537e200fc104 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:43.109658 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-aa947ece-6d3c-4df4-8e17-537e200fc104 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1222 microversion: 2.1 time: 0.154152 Nov 15 12:39:43.112100 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 13/22] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:42 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1222 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:39:43.246331 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-d8cecff0-edeb-42dd-8706-d49c91b1601c tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] Calling method '.version_select at 0x7f131bfa8820>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:43.294712 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-d8cecff0-edeb-42dd-8706-d49c91b1601c tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/9a6cdd1c-1dd7-426c-b487-a6cfb8d9ff5e" status: 200 len: 287 microversion: 2.1 time: 0.052007 Nov 15 12:39:43.295844 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 10/23] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Nov 15 12:39:43 2021] GET /compute/v2.1/os-snapshots/9a6cdd1c-1dd7-426c-b487-a6cfb8d9ff5e => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:39:43.306874 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-01e5db99-7355-420d-b4d4-6ca136bda0d5 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] Calling method '.version_select at 0x7f1321002b80>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:43.345896 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-3aa353eb-9a52-401d-aadd-a05c1eba0136 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1810845492", "imageRef": "3cc21e2c-27da-4266-be76-369023341c16", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d1a2a422-953b-42b1-8d45-4652cac485ba"}]}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:39:43.461719 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.network.neutron [None req-3aa353eb-9a52-401d-aadd-a05c1eba0136 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] validate_networks() for [('d1a2a422-953b-42b1-8d45-4652cac485ba', None, None, None, None, None)] {{(pid=122568) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 15 12:39:43.520157 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-01e5db99-7355-420d-b4d4-6ca136bda0d5 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] 10.222.0.43 "DELETE /compute/v2.1/os-snapshots/9a6cdd1c-1dd7-426c-b487-a6cfb8d9ff5e" status: 202 len: 0 microversion: 2.1 time: 0.217316 Nov 15 12:39:43.520819 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 14/24] 10.222.0.43 () {58 vars in 1253 bytes} [Mon Nov 15 12:39:43 2021] DELETE /compute/v2.1/os-snapshots/9a6cdd1c-1dd7-426c-b487-a6cfb8d9ff5e => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:39:43.529131 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-100236ee-7450-49c2-a69b-6b63fe49d154 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] Calling method '.version_select at 0x7f1321002e50>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:43.607642 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-100236ee-7450-49c2-a69b-6b63fe49d154 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/9a6cdd1c-1dd7-426c-b487-a6cfb8d9ff5e" status: 200 len: 286 microversion: 2.1 time: 0.082098 Nov 15 12:39:43.608205 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 15/25] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Nov 15 12:39:43 2021] GET /compute/v2.1/os-snapshots/9a6cdd1c-1dd7-426c-b487-a6cfb8d9ff5e => generated 286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 15 12:39:43.876564 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-0de8a860-83a9-43d3-952e-486e5bd4a45a tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:43.883781 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-0de8a860-83a9-43d3-952e-486e5bd4a45a tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:43.899342 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0de8a860-83a9-43d3-952e-486e5bd4a45a tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:43.908725 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0de8a860-83a9-43d3-952e-486e5bd4a45a tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:43.909820 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0de8a860-83a9-43d3-952e-486e5bd4a45a tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:43.911326 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0de8a860-83a9-43d3-952e-486e5bd4a45a tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:44.105290 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-0de8a860-83a9-43d3-952e-486e5bd4a45a tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:44.113972 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-0de8a860-83a9-43d3-952e-486e5bd4a45a tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1267 microversion: 2.1 time: 0.244310 Nov 15 12:39:44.119304 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 16/26] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:43 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1267 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:39:44.622181 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-095921db-4486-4088-88b9-8532555c9060 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] Calling method '.version_select at 0x7f1320fd9a60>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:44.682927 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-095921db-4486-4088-88b9-8532555c9060 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/9a6cdd1c-1dd7-426c-b487-a6cfb8d9ff5e" status: 200 len: 286 microversion: 2.1 time: 0.067539 Nov 15 12:39:44.683761 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 17/27] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Nov 15 12:39:44 2021] GET /compute/v2.1/os-snapshots/9a6cdd1c-1dd7-426c-b487-a6cfb8d9ff5e => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 15 12:39:44.792217 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-3aa353eb-9a52-401d-aadd-a05c1eba0136 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Flavor limits 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 15 12:39:44.792769 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-3aa353eb-9a52-401d-aadd-a05c1eba0136 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Image limits 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 15 12:39:44.793100 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-3aa353eb-9a52-401d-aadd-a05c1eba0136 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Flavor pref 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 15 12:39:44.793509 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-3aa353eb-9a52-401d-aadd-a05c1eba0136 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Image pref 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 15 12:39:44.793921 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-3aa353eb-9a52-401d-aadd-a05c1eba0136 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 15 12:39:44.815245 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3aa353eb-9a52-401d-aadd-a05c1eba0136 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:44.816002 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3aa353eb-9a52-401d-aadd-a05c1eba0136 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:44.820833 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3aa353eb-9a52-401d-aadd-a05c1eba0136 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:44.822673 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3aa353eb-9a52-401d-aadd-a05c1eba0136 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:44.862338 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-0c885c2c-3522-4f77-b05e-f1c6bf5ed8cc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1606608990", "imageRef": "3cc21e2c-27da-4266-be76-369023341c16", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46d33d4a-084c-4c8a-b96d-1c2b35f75a03"}], "security_groups": [{"name": "tempest-securitygroup--1283449273"}], "key_name": "tempest-keypair-954062943", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:39:44.872647 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-3aa353eb-9a52-401d-aadd-a05c1eba0136 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Getting quotas for project 66b782e267fb414c9bdfa078a438871a. Resources: {'cores', 'ram', 'instances'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:39:44.890955 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-3aa353eb-9a52-401d-aadd-a05c1eba0136 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Getting quotas for user c77087092d5b44e0b865de65e33e12bd and project 66b782e267fb414c9bdfa078a438871a. Resources: {'cores', 'ram', 'instances'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:39:44.913644 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-3aa353eb-9a52-401d-aadd-a05c1eba0136 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Going to run 1 instances... {{(pid=122568) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 15 12:39:44.916584 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-3aa353eb-9a52-401d-aadd-a05c1eba0136 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3cc21e2c-27da-4266-be76-369023341c16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 15 12:39:44.982136 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-3aa353eb-9a52-401d-aadd-a05c1eba0136 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.640194 Nov 15 12:39:44.983339 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 11/28] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Nov 15 12:39:43 2021] POST /compute/v2.1/servers => generated 383 bytes in 1642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 15 12:39:44.995301 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-5d8a69c1-52a3-445c-a700-24375f4c37d7 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:44.997228 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-5d8a69c1-52a3-445c-a700-24375f4c37d7 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:45.224992 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-5d8a69c1-52a3-445c-a700-24375f4c37d7 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:45.235150 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-5d8a69c1-52a3-445c-a700-24375f4c37d7 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1222 microversion: 2.1 time: 0.242485 Nov 15 12:39:45.236412 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 12/29] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:44 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1222 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:39:45.240876 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-90a7cda6-9f53-42bc-b6fd-d2a19c5c7ba6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:45.241537 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-90a7cda6-9f53-42bc-b6fd-d2a19c5c7ba6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:45.264741 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-90a7cda6-9f53-42bc-b6fd-d2a19c5c7ba6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:45.265286 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-90a7cda6-9f53-42bc-b6fd-d2a19c5c7ba6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:45.268385 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-90a7cda6-9f53-42bc-b6fd-d2a19c5c7ba6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:45.268827 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-90a7cda6-9f53-42bc-b6fd-d2a19c5c7ba6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:45.331465 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.network.neutron [None req-0c885c2c-3522-4f77-b05e-f1c6bf5ed8cc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] validate_networks() for [('46d33d4a-084c-4c8a-b96d-1c2b35f75a03', None, None, None, None, None)] {{(pid=122567) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 15 12:39:45.673699 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-90a7cda6-9f53-42bc-b6fd-d2a19c5c7ba6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:45.715847 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-90a7cda6-9f53-42bc-b6fd-d2a19c5c7ba6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1267 microversion: 2.1 time: 0.465968 Nov 15 12:39:45.731183 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 13/30] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:45 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1267 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:39:45.741962 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-24635d8d-9b82-41f0-9046-306b8ddb09b3 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] Calling method '.version_select at 0x7f131b6c5d30>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:45.809828 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-24635d8d-9b82-41f0-9046-306b8ddb09b3 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/9a6cdd1c-1dd7-426c-b487-a6cfb8d9ff5e" status: 200 len: 286 microversion: 2.1 time: 0.076218 Nov 15 12:39:45.812131 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 14/31] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Nov 15 12:39:45 2021] GET /compute/v2.1/os-snapshots/9a6cdd1c-1dd7-426c-b487-a6cfb8d9ff5e => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:39:46.256230 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-aa5534cf-2d4a-41f2-ae8d-6e358f6cd612 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:46.257201 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-aa5534cf-2d4a-41f2-ae8d-6e358f6cd612 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:46.269418 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-aa5534cf-2d4a-41f2-ae8d-6e358f6cd612 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:46.273959 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-aa5534cf-2d4a-41f2-ae8d-6e358f6cd612 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:46.275699 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-aa5534cf-2d4a-41f2-ae8d-6e358f6cd612 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:46.276552 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-aa5534cf-2d4a-41f2-ae8d-6e358f6cd612 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:46.448636 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-aa5534cf-2d4a-41f2-ae8d-6e358f6cd612 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:46.462202 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-aa5534cf-2d4a-41f2-ae8d-6e358f6cd612 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1218 microversion: 2.1 time: 0.213188 Nov 15 12:39:46.468288 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 15/32] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:46 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1218 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:39:46.743855 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-1651be81-4e73-4f44-a480-f6f2f5653e93 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:46.744862 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-1651be81-4e73-4f44-a480-f6f2f5653e93 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:46.770948 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1651be81-4e73-4f44-a480-f6f2f5653e93 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:46.771407 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1651be81-4e73-4f44-a480-f6f2f5653e93 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:46.774033 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1651be81-4e73-4f44-a480-f6f2f5653e93 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:46.784383 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1651be81-4e73-4f44-a480-f6f2f5653e93 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:46.944013 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-1651be81-4e73-4f44-a480-f6f2f5653e93 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:46.958248 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-1651be81-4e73-4f44-a480-f6f2f5653e93 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1275 microversion: 2.1 time: 0.223094 Nov 15 12:39:46.968136 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 16/33] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:46 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1275 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:39:46.972855 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-3e83e8ca-ac69-4b96-a0d0-75a078ef8360 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] Calling method '.version_select at 0x7f131b691c10>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:47.012859 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-0c885c2c-3522-4f77-b05e-f1c6bf5ed8cc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Flavor limits 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 15 12:39:47.012859 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-0c885c2c-3522-4f77-b05e-f1c6bf5ed8cc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Image limits 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 15 12:39:47.012859 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-0c885c2c-3522-4f77-b05e-f1c6bf5ed8cc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Flavor pref 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 15 12:39:47.012859 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-0c885c2c-3522-4f77-b05e-f1c6bf5ed8cc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Image pref 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 15 12:39:47.012859 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-0c885c2c-3522-4f77-b05e-f1c6bf5ed8cc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 15 12:39:47.028149 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-3e83e8ca-ac69-4b96-a0d0-75a078ef8360 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/9a6cdd1c-1dd7-426c-b487-a6cfb8d9ff5e" status: 200 len: 286 microversion: 2.1 time: 0.067686 Nov 15 12:39:47.028469 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0c885c2c-3522-4f77-b05e-f1c6bf5ed8cc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:47.028726 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 17/34] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Nov 15 12:39:46 2021] GET /compute/v2.1/os-snapshots/9a6cdd1c-1dd7-426c-b487-a6cfb8d9ff5e => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:39:47.034194 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0c885c2c-3522-4f77-b05e-f1c6bf5ed8cc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:47.035269 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0c885c2c-3522-4f77-b05e-f1c6bf5ed8cc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:47.035716 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0c885c2c-3522-4f77-b05e-f1c6bf5ed8cc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:47.072648 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.quota [None req-0c885c2c-3522-4f77-b05e-f1c6bf5ed8cc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Getting quotas for project b91bd39e4f3b40f396370b06f870aeb6. Resources: {'cores', 'ram', 'instances'} {{(pid=122567) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:39:47.081653 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.quota [None req-0c885c2c-3522-4f77-b05e-f1c6bf5ed8cc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Getting quotas for user 1f4fb2fdbe754d13af2222261fddbbdc and project b91bd39e4f3b40f396370b06f870aeb6. Resources: {'cores', 'ram', 'instances'} {{(pid=122567) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:39:47.103310 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-0c885c2c-3522-4f77-b05e-f1c6bf5ed8cc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Going to run 1 instances... {{(pid=122567) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 15 12:39:47.106089 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-0c885c2c-3522-4f77-b05e-f1c6bf5ed8cc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3cc21e2c-27da-4266-be76-369023341c16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 15 12:39:47.254624 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-0c885c2c-3522-4f77-b05e-f1c6bf5ed8cc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.397547 Nov 15 12:39:47.257632 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 18/35] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Nov 15 12:39:44 2021] POST /compute/v2.1/servers => generated 402 bytes in 2401 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 15 12:39:47.269428 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-e3228473-7c02-4482-bf99-7d745cc9c09c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:47.270048 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-e3228473-7c02-4482-bf99-7d745cc9c09c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:47.396660 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-e3228473-7c02-4482-bf99-7d745cc9c09c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:47.414020 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-e3228473-7c02-4482-bf99-7d745cc9c09c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1237 microversion: 2.1 time: 0.148969 Nov 15 12:39:47.414609 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 18/36] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:47 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1237 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:39:47.485880 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-4c56a386-4926-4bf0-b8ff-35e8a473233c tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:47.486837 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-4c56a386-4926-4bf0-b8ff-35e8a473233c tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:47.500743 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4c56a386-4926-4bf0-b8ff-35e8a473233c tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:47.507052 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4c56a386-4926-4bf0-b8ff-35e8a473233c tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:47.508240 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4c56a386-4926-4bf0-b8ff-35e8a473233c tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:47.509012 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4c56a386-4926-4bf0-b8ff-35e8a473233c tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:47.640260 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-4c56a386-4926-4bf0-b8ff-35e8a473233c tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:47.650252 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-4c56a386-4926-4bf0-b8ff-35e8a473233c tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1218 microversion: 2.1 time: 0.169015 Nov 15 12:39:47.651372 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 19/37] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:47 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1218 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:39:47.977154 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-fb14e318-f379-4eee-80a1-7336563a2ce2 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:47.979048 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-fb14e318-f379-4eee-80a1-7336563a2ce2 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:47.985829 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fb14e318-f379-4eee-80a1-7336563a2ce2 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:47.987302 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fb14e318-f379-4eee-80a1-7336563a2ce2 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:47.988385 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fb14e318-f379-4eee-80a1-7336563a2ce2 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:47.988833 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fb14e318-f379-4eee-80a1-7336563a2ce2 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:48.040691 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-c978cdb4-4e1f-4348-bffe-0b316e1dbdb0 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] Calling method '.version_select at 0x7f13206fbca0>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:48.065399 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-fb14e318-f379-4eee-80a1-7336563a2ce2 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:48.074532 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-fb14e318-f379-4eee-80a1-7336563a2ce2 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1275 microversion: 2.1 time: 0.102719 Nov 15 12:39:48.075859 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 19/38] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:47 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1275 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:39:48.093049 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-c978cdb4-4e1f-4348-bffe-0b316e1dbdb0 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/9a6cdd1c-1dd7-426c-b487-a6cfb8d9ff5e" status: 200 len: 286 microversion: 2.1 time: 0.055881 Nov 15 12:39:48.093620 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 20/39] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Nov 15 12:39:48 2021] GET /compute/v2.1/os-snapshots/9a6cdd1c-1dd7-426c-b487-a6cfb8d9ff5e => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 15 12:39:48.432354 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-dd80e64a-e62c-40ee-b9cf-0443b632f3c0 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:48.432968 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-dd80e64a-e62c-40ee-b9cf-0443b632f3c0 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:48.439742 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-dd80e64a-e62c-40ee-b9cf-0443b632f3c0 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:48.440191 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-dd80e64a-e62c-40ee-b9cf-0443b632f3c0 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:48.440973 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-dd80e64a-e62c-40ee-b9cf-0443b632f3c0 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:48.441410 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-dd80e64a-e62c-40ee-b9cf-0443b632f3c0 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:48.531736 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-dd80e64a-e62c-40ee-b9cf-0443b632f3c0 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:48.540526 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-dd80e64a-e62c-40ee-b9cf-0443b632f3c0 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1241 microversion: 2.1 time: 0.112234 Nov 15 12:39:48.541423 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 20/40] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:48 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1241 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:39:48.668127 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-590444ae-5bfa-40b0-b2f0-f820c18c660a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:48.668949 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-590444ae-5bfa-40b0-b2f0-f820c18c660a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:48.675839 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-590444ae-5bfa-40b0-b2f0-f820c18c660a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:48.676298 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-590444ae-5bfa-40b0-b2f0-f820c18c660a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:48.677044 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-590444ae-5bfa-40b0-b2f0-f820c18c660a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:48.677475 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-590444ae-5bfa-40b0-b2f0-f820c18c660a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:48.756058 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-590444ae-5bfa-40b0-b2f0-f820c18c660a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:48.775611 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-590444ae-5bfa-40b0-b2f0-f820c18c660a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1218 microversion: 2.1 time: 0.111430 Nov 15 12:39:48.785725 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 21/41] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:48 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1218 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:39:49.095555 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-ef7519bd-6b3b-4bb9-8a0f-caf47c810d81 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:49.096391 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-ef7519bd-6b3b-4bb9-8a0f-caf47c810d81 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:49.103856 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ef7519bd-6b3b-4bb9-8a0f-caf47c810d81 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:49.104361 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ef7519bd-6b3b-4bb9-8a0f-caf47c810d81 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:49.105260 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e1bda403-8183-4b4e-9050-2550f817cc13 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] Calling method '.version_select at 0x7f1320709790>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:49.114159 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ef7519bd-6b3b-4bb9-8a0f-caf47c810d81 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:49.114656 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ef7519bd-6b3b-4bb9-8a0f-caf47c810d81 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:49.162137 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e1bda403-8183-4b4e-9050-2550f817cc13 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/9a6cdd1c-1dd7-426c-b487-a6cfb8d9ff5e" status: 200 len: 286 microversion: 2.1 time: 0.061740 Nov 15 12:39:49.162807 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 22/42] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Nov 15 12:39:49 2021] GET /compute/v2.1/os-snapshots/9a6cdd1c-1dd7-426c-b487-a6cfb8d9ff5e => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 15 12:39:49.308881 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-ef7519bd-6b3b-4bb9-8a0f-caf47c810d81 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:49.322196 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-ef7519bd-6b3b-4bb9-8a0f-caf47c810d81 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1273 microversion: 2.1 time: 0.232061 Nov 15 12:39:49.323999 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 21/43] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:49 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1273 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:39:49.564279 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-843f30f4-bd59-4753-af0a-89ddbf5695d1 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:49.566054 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-843f30f4-bd59-4753-af0a-89ddbf5695d1 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:49.581606 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-843f30f4-bd59-4753-af0a-89ddbf5695d1 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:49.582007 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-843f30f4-bd59-4753-af0a-89ddbf5695d1 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:49.585280 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-843f30f4-bd59-4753-af0a-89ddbf5695d1 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:49.585784 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-843f30f4-bd59-4753-af0a-89ddbf5695d1 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:49.795790 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-b272b0e4-0276-43b8-b713-99f54f3b8dce tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:49.796636 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-b272b0e4-0276-43b8-b713-99f54f3b8dce tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:49.805150 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b272b0e4-0276-43b8-b713-99f54f3b8dce tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:49.805781 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b272b0e4-0276-43b8-b713-99f54f3b8dce tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:49.806717 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b272b0e4-0276-43b8-b713-99f54f3b8dce tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:49.807632 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b272b0e4-0276-43b8-b713-99f54f3b8dce tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:49.810124 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-843f30f4-bd59-4753-af0a-89ddbf5695d1 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:49.825111 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-843f30f4-bd59-4753-af0a-89ddbf5695d1 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1233 microversion: 2.1 time: 0.265451 Nov 15 12:39:49.826354 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 23/44] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:49 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1233 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:39:50.022892 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-b272b0e4-0276-43b8-b713-99f54f3b8dce tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:50.031016 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-b272b0e4-0276-43b8-b713-99f54f3b8dce tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1274 microversion: 2.1 time: 0.238697 Nov 15 12:39:50.050488 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 22/45] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:49 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1274 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:39:50.182718 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-ccf1fb2c-6b29-4bdd-a25d-067ded5e53fd tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] Calling method '.version_select at 0x7f1320709940>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:50.351006 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-9131bc50-bbfa-41d9-84b9-1060f179ad0c tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:50.353614 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-9131bc50-bbfa-41d9-84b9-1060f179ad0c tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:50.365277 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9131bc50-bbfa-41d9-84b9-1060f179ad0c tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:50.366255 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9131bc50-bbfa-41d9-84b9-1060f179ad0c tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:50.367370 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9131bc50-bbfa-41d9-84b9-1060f179ad0c tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:50.368650 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9131bc50-bbfa-41d9-84b9-1060f179ad0c tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:50.372050 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.wsgi [None req-ccf1fb2c-6b29-4bdd-a25d-067ded5e53fd tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] HTTP exception thrown: Snapshot 9a6cdd1c-1dd7-426c-b487-a6cfb8d9ff5e could not be found. Nov 15 12:39:50.373190 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-ccf1fb2c-6b29-4bdd-a25d-067ded5e53fd tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] Returning 404 to user: Snapshot 9a6cdd1c-1dd7-426c-b487-a6cfb8d9ff5e could not be found. {{(pid=122567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:39:50.375001 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-ccf1fb2c-6b29-4bdd-a25d-067ded5e53fd tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/9a6cdd1c-1dd7-426c-b487-a6cfb8d9ff5e" status: 404 len: 111 microversion: 2.1 time: 0.204753 Nov 15 12:39:50.379225 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 24/46] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Nov 15 12:39:50 2021] GET /compute/v2.1/os-snapshots/9a6cdd1c-1dd7-426c-b487-a6cfb8d9ff5e => generated 111 bytes in 210 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 15 12:39:50.392165 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-1bc1683f-8471-414e-9285-a284c356f43f tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] Calling method '.version_select at 0x7f1321a6b280>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:50.742997 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-1bc1683f-8471-414e-9285-a284c356f43f tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/9ddc24b9-5708-4d3c-80ee-e67d1bac2771" status: 202 len: 0 microversion: 2.1 time: 0.359406 Nov 15 12:39:50.744299 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 25/47] 10.222.0.43 () {58 vars in 1247 bytes} [Mon Nov 15 12:39:50 2021] DELETE /compute/v2.1/os-volumes/9ddc24b9-5708-4d3c-80ee-e67d1bac2771 => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 15 12:39:50.754929 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-4bd41902-41fd-4ef0-b6e0-eefb8eff54c9 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] Calling method '.version_select at 0x7f1320709820>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:50.909448 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-4bd41902-41fd-4ef0-b6e0-eefb8eff54c9 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/9ddc24b9-5708-4d3c-80ee-e67d1bac2771" status: 200 len: 345 microversion: 2.1 time: 0.160187 Nov 15 12:39:50.910111 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 26/48] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Nov 15 12:39:50 2021] GET /compute/v2.1/os-volumes/9ddc24b9-5708-4d3c-80ee-e67d1bac2771 => generated 345 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:39:50.916457 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-9e347234-1ea1-4ef1-99b6-3544c5cd0808 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:50.921210 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-9e347234-1ea1-4ef1-99b6-3544c5cd0808 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:50.942754 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9e347234-1ea1-4ef1-99b6-3544c5cd0808 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:50.947519 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9e347234-1ea1-4ef1-99b6-3544c5cd0808 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:50.952176 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9e347234-1ea1-4ef1-99b6-3544c5cd0808 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:50.952698 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9e347234-1ea1-4ef1-99b6-3544c5cd0808 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:51.156264 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-9e347234-1ea1-4ef1-99b6-3544c5cd0808 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:51.168801 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-9e347234-1ea1-4ef1-99b6-3544c5cd0808 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1297 microversion: 2.1 time: 0.255764 Nov 15 12:39:51.170318 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 27/49] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:50 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1297 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:39:51.193551 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-d1791481-7525-4c8d-9c48-addae692d037 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:51.195330 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-d1791481-7525-4c8d-9c48-addae692d037 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:51.205644 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d1791481-7525-4c8d-9c48-addae692d037 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:51.206613 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d1791481-7525-4c8d-9c48-addae692d037 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:51.208305 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d1791481-7525-4c8d-9c48-addae692d037 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:51.209918 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d1791481-7525-4c8d-9c48-addae692d037 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:51.464817 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-d1791481-7525-4c8d-9c48-addae692d037 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:51.488431 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-d1791481-7525-4c8d-9c48-addae692d037 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1280 microversion: 2.1 time: 0.315807 Nov 15 12:39:51.489304 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 28/50] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:51 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1280 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:39:51.569774 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-9131bc50-bbfa-41d9-84b9-1060f179ad0c tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:51.581222 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-9131bc50-bbfa-41d9-84b9-1060f179ad0c tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1315 microversion: 2.1 time: 1.241062 Nov 15 12:39:51.584109 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 23/51] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:50 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1315 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:39:51.923141 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-16842d9c-45b4-420e-8237-9df6a9f67e9c tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] Calling method '.version_select at 0x7f13206fbd30>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:52.130891 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.wsgi [None req-16842d9c-45b4-420e-8237-9df6a9f67e9c tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] HTTP exception thrown: Volume 9ddc24b9-5708-4d3c-80ee-e67d1bac2771 could not be found. Nov 15 12:39:52.131683 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-16842d9c-45b4-420e-8237-9df6a9f67e9c tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] Returning 404 to user: Volume 9ddc24b9-5708-4d3c-80ee-e67d1bac2771 could not be found. {{(pid=122567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:39:52.133039 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-16842d9c-45b4-420e-8237-9df6a9f67e9c tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/9ddc24b9-5708-4d3c-80ee-e67d1bac2771" status: 404 len: 109 microversion: 2.1 time: 0.214190 Nov 15 12:39:52.133714 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 29/52] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Nov 15 12:39:51 2021] GET /compute/v2.1/os-volumes/9ddc24b9-5708-4d3c-80ee-e67d1bac2771 => generated 109 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 15 12:39:52.145982 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-80b1bec2-abb8-46f3-89d7-fbb4db6a7f91 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] Calling method '.version_select at 0x7f131bf8f8b0>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:52.193609 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-d09b5eb6-5b70-4df8-988e-606944298a9d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:52.194282 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-d09b5eb6-5b70-4df8-988e-606944298a9d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:52.205551 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d09b5eb6-5b70-4df8-988e-606944298a9d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:52.206007 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d09b5eb6-5b70-4df8-988e-606944298a9d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:52.216941 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d09b5eb6-5b70-4df8-988e-606944298a9d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:52.219011 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d09b5eb6-5b70-4df8-988e-606944298a9d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:52.247883 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.wsgi [None req-80b1bec2-abb8-46f3-89d7-fbb4db6a7f91 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] HTTP exception thrown: Volume 9ddc24b9-5708-4d3c-80ee-e67d1bac2771 could not be found. Nov 15 12:39:52.248369 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-80b1bec2-abb8-46f3-89d7-fbb4db6a7f91 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] Returning 404 to user: Volume 9ddc24b9-5708-4d3c-80ee-e67d1bac2771 could not be found. {{(pid=122568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:39:52.248931 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-80b1bec2-abb8-46f3-89d7-fbb4db6a7f91 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/9ddc24b9-5708-4d3c-80ee-e67d1bac2771" status: 404 len: 109 microversion: 2.1 time: 0.107499 Nov 15 12:39:52.249991 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 24/53] 10.222.0.43 () {58 vars in 1247 bytes} [Mon Nov 15 12:39:52 2021] DELETE /compute/v2.1/os-volumes/9ddc24b9-5708-4d3c-80ee-e67d1bac2771 => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 15 12:39:52.260626 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-066d69b6-7da9-4629-a5eb-e67b0eee43c2 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] Calling method '.version_select at 0x7f1321a6d310>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:52.334556 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.wsgi [None req-066d69b6-7da9-4629-a5eb-e67b0eee43c2 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] HTTP exception thrown: Volume 9ddc24b9-5708-4d3c-80ee-e67d1bac2771 could not be found. Nov 15 12:39:52.335380 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-066d69b6-7da9-4629-a5eb-e67b0eee43c2 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] Returning 404 to user: Volume 9ddc24b9-5708-4d3c-80ee-e67d1bac2771 could not be found. {{(pid=122568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:39:52.336454 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-066d69b6-7da9-4629-a5eb-e67b0eee43c2 tempest-VolumesSnapshotsTestJSON-1169918875 tempest-VolumesSnapshotsTestJSON-1169918875-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/9ddc24b9-5708-4d3c-80ee-e67d1bac2771" status: 404 len: 109 microversion: 2.1 time: 0.081614 Nov 15 12:39:52.337221 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 25/54] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Nov 15 12:39:52 2021] GET /compute/v2.1/os-volumes/9ddc24b9-5708-4d3c-80ee-e67d1bac2771 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 15 12:39:52.422099 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-d09b5eb6-5b70-4df8-988e-606944298a9d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:52.432287 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-d09b5eb6-5b70-4df8-988e-606944298a9d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1295 microversion: 2.1 time: 0.247180 Nov 15 12:39:52.444787 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 30/55] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:52 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1295 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:39:52.507957 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-0a521549-2369-462c-bd39-dd4aa948ca0f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:52.508999 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-0a521549-2369-462c-bd39-dd4aa948ca0f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:52.518523 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0a521549-2369-462c-bd39-dd4aa948ca0f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:52.520440 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0a521549-2369-462c-bd39-dd4aa948ca0f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:52.522399 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0a521549-2369-462c-bd39-dd4aa948ca0f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:52.524484 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0a521549-2369-462c-bd39-dd4aa948ca0f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:52.602309 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-3a8d0e59-176c-4c21-bbb2-664ec4402184 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:52.603209 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-3a8d0e59-176c-4c21-bbb2-664ec4402184 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:52.621429 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3a8d0e59-176c-4c21-bbb2-664ec4402184 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:52.622687 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3a8d0e59-176c-4c21-bbb2-664ec4402184 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:52.624908 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3a8d0e59-176c-4c21-bbb2-664ec4402184 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:52.626989 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3a8d0e59-176c-4c21-bbb2-664ec4402184 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:52.744064 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-0a521549-2369-462c-bd39-dd4aa948ca0f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:52.758139 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-0a521549-2369-462c-bd39-dd4aa948ca0f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1280 microversion: 2.1 time: 0.251433 Nov 15 12:39:52.762788 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 26/56] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:52 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1280 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:39:53.129413 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-3a8d0e59-176c-4c21-bbb2-664ec4402184 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:53.147281 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-3a8d0e59-176c-4c21-bbb2-664ec4402184 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1315 microversion: 2.1 time: 0.549736 Nov 15 12:39:53.154628 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 31/57] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:52 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1315 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:39:53.450098 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-77afb8a3-ff99-40a0-baed-6376f3a8a630 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:53.450708 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-77afb8a3-ff99-40a0-baed-6376f3a8a630 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:53.460065 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-77afb8a3-ff99-40a0-baed-6376f3a8a630 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:53.460529 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-77afb8a3-ff99-40a0-baed-6376f3a8a630 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:53.462292 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-77afb8a3-ff99-40a0-baed-6376f3a8a630 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:53.463114 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-77afb8a3-ff99-40a0-baed-6376f3a8a630 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:53.597812 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-77afb8a3-ff99-40a0-baed-6376f3a8a630 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:53.607434 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-77afb8a3-ff99-40a0-baed-6376f3a8a630 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1295 microversion: 2.1 time: 0.160317 Nov 15 12:39:53.615472 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 27/58] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:53 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1295 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:39:53.780639 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-a1d4a37e-3893-4c32-be70-2116d358a085 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:53.781247 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-a1d4a37e-3893-4c32-be70-2116d358a085 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:53.800560 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a1d4a37e-3893-4c32-be70-2116d358a085 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:53.801247 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a1d4a37e-3893-4c32-be70-2116d358a085 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:53.802536 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a1d4a37e-3893-4c32-be70-2116d358a085 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:53.803474 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a1d4a37e-3893-4c32-be70-2116d358a085 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:54.120110 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-a1d4a37e-3893-4c32-be70-2116d358a085 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:54.136372 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-a1d4a37e-3893-4c32-be70-2116d358a085 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1322 microversion: 2.1 time: 0.359148 Nov 15 12:39:54.147591 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 32/59] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:53 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1322 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:39:54.183591 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-817d9e9d-6119-433a-bb68-302b82386fa6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:54.185612 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-817d9e9d-6119-433a-bb68-302b82386fa6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:54.196575 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-817d9e9d-6119-433a-bb68-302b82386fa6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:54.197724 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-817d9e9d-6119-433a-bb68-302b82386fa6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:54.198709 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-817d9e9d-6119-433a-bb68-302b82386fa6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:54.199644 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-817d9e9d-6119-433a-bb68-302b82386fa6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:54.467994 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-817d9e9d-6119-433a-bb68-302b82386fa6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:54.478013 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-817d9e9d-6119-433a-bb68-302b82386fa6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1315 microversion: 2.1 time: 0.301415 Nov 15 12:39:54.478854 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 28/60] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:54 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:39:54.625137 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-f7df3f12-2dd8-4c37-9abb-60a8b5583b03 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:54.626284 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-f7df3f12-2dd8-4c37-9abb-60a8b5583b03 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:54.632924 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f7df3f12-2dd8-4c37-9abb-60a8b5583b03 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:54.633406 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f7df3f12-2dd8-4c37-9abb-60a8b5583b03 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:54.634171 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f7df3f12-2dd8-4c37-9abb-60a8b5583b03 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:54.634601 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f7df3f12-2dd8-4c37-9abb-60a8b5583b03 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:54.696391 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [req-a060c183-b2e4-497c-8367-34fe86acbcfd req-2a487a04-3d3d-452f-b261-fc2f942ca6eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10b7dd7b-ae59-4375-b46b-47dacaf4be62", "tag": "6b8d7663-6fa5-48c7-b3b3-f2a4a7d6782e"}]} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:39:54.698699 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-f7df3f12-2dd8-4c37-9abb-60a8b5583b03 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:54.699169 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:39:54.699169 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: warnings.warn(msg) Nov 15 12:39:54.708118 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-f7df3f12-2dd8-4c37-9abb-60a8b5583b03 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1295 microversion: 2.1 time: 0.086605 Nov 15 12:39:54.709097 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 29/61] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:54 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1295 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:39:54.718047 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-a060c183-b2e4-497c-8367-34fe86acbcfd req-2a487a04-3d3d-452f-b261-fc2f942ca6eb service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:54.718047 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-a060c183-b2e4-497c-8367-34fe86acbcfd req-2a487a04-3d3d-452f-b261-fc2f942ca6eb service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:54.736295 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.compute.server_external_events [req-a060c183-b2e4-497c-8367-34fe86acbcfd req-2a487a04-3d3d-452f-b261-fc2f942ca6eb service nova] Creating event network-changed:6b8d7663-6fa5-48c7-b3b3-f2a4a7d6782e for instance 10b7dd7b-ae59-4375-b46b-47dacaf4be62 on hv-cinder-68088 Nov 15 12:39:54.737226 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-a060c183-b2e4-497c-8367-34fe86acbcfd req-2a487a04-3d3d-452f-b261-fc2f942ca6eb service nova] Acquired lock "compute-rpcapi-router" {{(pid=122567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 15 12:39:54.738569 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-70c589c1-feec-485c-8ec7-b90a3c7d7b5c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:54.739202 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-70c589c1-feec-485c-8ec7-b90a3c7d7b5c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:54.740208 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-70c589c1-feec-485c-8ec7-b90a3c7d7b5c None None] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:54.740800 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-70c589c1-feec-485c-8ec7-b90a3c7d7b5c None None] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:54.749144 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.compute.rpcapi [None req-70c589c1-feec-485c-8ec7-b90a3c7d7b5c None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 15 12:39:54.750016 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-70c589c1-feec-485c-8ec7-b90a3c7d7b5c None None] Releasing lock "compute-rpcapi-router" {{(pid=122567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 15 12:39:54.774424 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-70c589c1-feec-485c-8ec7-b90a3c7d7b5c None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.277884 Nov 15 12:39:54.775418 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 33/62] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:39:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:39:55.156176 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-e9fc88f2-5e32-4af5-9b55-f62390766b68 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:55.156176 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-e9fc88f2-5e32-4af5-9b55-f62390766b68 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:55.162240 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e9fc88f2-5e32-4af5-9b55-f62390766b68 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:55.162240 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e9fc88f2-5e32-4af5-9b55-f62390766b68 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:55.163018 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e9fc88f2-5e32-4af5-9b55-f62390766b68 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:55.163599 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e9fc88f2-5e32-4af5-9b55-f62390766b68 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:55.324795 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-e9fc88f2-5e32-4af5-9b55-f62390766b68 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:55.333412 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-e9fc88f2-5e32-4af5-9b55-f62390766b68 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1322 microversion: 2.1 time: 0.182608 Nov 15 12:39:55.334074 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 30/63] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:55 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:39:55.495987 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-9be08109-84d6-40b5-8a88-ab56bbb67289 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:55.496695 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-9be08109-84d6-40b5-8a88-ab56bbb67289 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:55.506661 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9be08109-84d6-40b5-8a88-ab56bbb67289 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:55.513910 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9be08109-84d6-40b5-8a88-ab56bbb67289 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:55.513910 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9be08109-84d6-40b5-8a88-ab56bbb67289 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:55.513910 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9be08109-84d6-40b5-8a88-ab56bbb67289 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:55.726993 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-6307c0ad-66f7-48a1-a0b8-bc795bd474cc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:55.727928 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-6307c0ad-66f7-48a1-a0b8-bc795bd474cc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:55.730516 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-9be08109-84d6-40b5-8a88-ab56bbb67289 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:55.743796 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6307c0ad-66f7-48a1-a0b8-bc795bd474cc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:55.744354 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6307c0ad-66f7-48a1-a0b8-bc795bd474cc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:55.745164 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6307c0ad-66f7-48a1-a0b8-bc795bd474cc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:55.746600 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-9be08109-84d6-40b5-8a88-ab56bbb67289 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1315 microversion: 2.1 time: 0.254692 Nov 15 12:39:55.747885 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 34/64] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:55 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:39:55.767152 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6307c0ad-66f7-48a1-a0b8-bc795bd474cc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:55.954564 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-6307c0ad-66f7-48a1-a0b8-bc795bd474cc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:55.971145 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-6307c0ad-66f7-48a1-a0b8-bc795bd474cc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1295 microversion: 2.1 time: 0.239950 Nov 15 12:39:55.972030 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 31/65] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:55 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1295 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:39:56.362220 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-71340ad7-09fa-469a-8239-05f6ec8a3d77 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:56.364731 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-71340ad7-09fa-469a-8239-05f6ec8a3d77 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:56.381174 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-71340ad7-09fa-469a-8239-05f6ec8a3d77 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:56.382140 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-71340ad7-09fa-469a-8239-05f6ec8a3d77 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:56.384371 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-71340ad7-09fa-469a-8239-05f6ec8a3d77 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:56.386123 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-71340ad7-09fa-469a-8239-05f6ec8a3d77 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:56.736311 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-71340ad7-09fa-469a-8239-05f6ec8a3d77 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:56.752548 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-71340ad7-09fa-469a-8239-05f6ec8a3d77 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1322 microversion: 2.1 time: 0.404341 Nov 15 12:39:56.765492 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-6dd247c2-eecd-455a-a7c1-247609d8d3fd tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:56.765492 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-6dd247c2-eecd-455a-a7c1-247609d8d3fd tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:56.766968 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 35/66] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:56 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1322 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:39:56.771585 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6dd247c2-eecd-455a-a7c1-247609d8d3fd tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:56.772033 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6dd247c2-eecd-455a-a7c1-247609d8d3fd tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:56.773009 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6dd247c2-eecd-455a-a7c1-247609d8d3fd tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:56.773449 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6dd247c2-eecd-455a-a7c1-247609d8d3fd tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:56.978308 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-6dd247c2-eecd-455a-a7c1-247609d8d3fd tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:56.987674 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-6dd247c2-eecd-455a-a7c1-247609d8d3fd tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1315 microversion: 2.1 time: 0.228069 Nov 15 12:39:56.988452 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 32/67] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:56 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:39:57.015431 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-f0596642-b983-4558-8e10-89acaaaf8e39 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:57.016254 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-f0596642-b983-4558-8e10-89acaaaf8e39 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:57.027430 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f0596642-b983-4558-8e10-89acaaaf8e39 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:57.029017 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f0596642-b983-4558-8e10-89acaaaf8e39 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:57.030809 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f0596642-b983-4558-8e10-89acaaaf8e39 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:57.031276 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f0596642-b983-4558-8e10-89acaaaf8e39 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:57.078239 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-db7b0925-abb1-487f-897e-4113d5ef4570 tempest-VolumesTestJSON-1077059518 tempest-VolumesTestJSON-1077059518-project] Calling method '.version_select at 0x7f131b691040>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:57.106496 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-f0596642-b983-4558-8e10-89acaaaf8e39 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:57.116107 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-f0596642-b983-4558-8e10-89acaaaf8e39 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1295 microversion: 2.1 time: 0.105494 Nov 15 12:39:57.127070 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 36/68] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:57 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1295 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:39:57.148607 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-db7b0925-abb1-487f-897e-4113d5ef4570 tempest-VolumesTestJSON-1077059518 tempest-VolumesTestJSON-1077059518-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/81041703-c457-46bf-ae44-432bf7afb68e" status: 200 len: 350 microversion: 2.1 time: 0.084101 Nov 15 12:39:57.149440 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 33/69] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Nov 15 12:39:57 2021] GET /compute/v2.1/os-volumes/81041703-c457-46bf-ae44-432bf7afb68e => generated 350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:39:57.772817 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-c13ede34-9726-4c25-ae69-212b16039e2f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:57.773716 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-c13ede34-9726-4c25-ae69-212b16039e2f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:57.780016 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c13ede34-9726-4c25-ae69-212b16039e2f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:57.780716 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c13ede34-9726-4c25-ae69-212b16039e2f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:57.781688 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c13ede34-9726-4c25-ae69-212b16039e2f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:57.782575 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c13ede34-9726-4c25-ae69-212b16039e2f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:57.972346 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-c13ede34-9726-4c25-ae69-212b16039e2f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:57.982808 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-c13ede34-9726-4c25-ae69-212b16039e2f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1322 microversion: 2.1 time: 0.213326 Nov 15 12:39:57.983973 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 37/70] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:57 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:39:58.028762 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-6864b2a5-115a-4249-aa8c-ac39d1ff8d26 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:58.030115 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-6864b2a5-115a-4249-aa8c-ac39d1ff8d26 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:58.057383 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6864b2a5-115a-4249-aa8c-ac39d1ff8d26 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:58.058755 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6864b2a5-115a-4249-aa8c-ac39d1ff8d26 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:58.060588 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6864b2a5-115a-4249-aa8c-ac39d1ff8d26 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:58.062817 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6864b2a5-115a-4249-aa8c-ac39d1ff8d26 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:58.133937 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-171e0692-d544-4286-8624-c9195b06f1a6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:58.134557 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-171e0692-d544-4286-8624-c9195b06f1a6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:58.153242 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-171e0692-d544-4286-8624-c9195b06f1a6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:58.154263 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-171e0692-d544-4286-8624-c9195b06f1a6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:58.159878 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-171e0692-d544-4286-8624-c9195b06f1a6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:58.162011 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-171e0692-d544-4286-8624-c9195b06f1a6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:58.336101 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-171e0692-d544-4286-8624-c9195b06f1a6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:58.340289 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-6864b2a5-115a-4249-aa8c-ac39d1ff8d26 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:58.357040 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-171e0692-d544-4286-8624-c9195b06f1a6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1295 microversion: 2.1 time: 0.216991 Nov 15 12:39:58.360513 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-6864b2a5-115a-4249-aa8c-ac39d1ff8d26 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1315 microversion: 2.1 time: 0.359989 Nov 15 12:39:58.361271 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 34/71] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:57 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:39:58.371320 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 38/72] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:58 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1295 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:39:58.589932 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-184b07b3-71d2-47e1-8891-ee1b99e67d8b tempest-VolumesTestJSON-1077059518 tempest-VolumesTestJSON-1077059518-project] Calling method '.version_select at 0x7f131b6e9700>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:58.668273 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-184b07b3-71d2-47e1-8891-ee1b99e67d8b tempest-VolumesTestJSON-1077059518 tempest-VolumesTestJSON-1077059518-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/1ab766f7-eb74-41a8-8d9c-4202e0fa886b" status: 200 len: 350 microversion: 2.1 time: 0.089819 Nov 15 12:39:58.668865 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 35/73] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Nov 15 12:39:58 2021] GET /compute/v2.1/os-volumes/1ab766f7-eb74-41a8-8d9c-4202e0fa886b => generated 350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:39:58.999856 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-dd1ec232-5b4b-4c65-a876-2292bc5de09f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:59.001149 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-dd1ec232-5b4b-4c65-a876-2292bc5de09f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:59.008633 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-dd1ec232-5b4b-4c65-a876-2292bc5de09f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:59.009218 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-dd1ec232-5b4b-4c65-a876-2292bc5de09f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:59.010139 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-dd1ec232-5b4b-4c65-a876-2292bc5de09f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:59.010702 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-dd1ec232-5b4b-4c65-a876-2292bc5de09f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:59.185840 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-dd1ec232-5b4b-4c65-a876-2292bc5de09f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:59.198893 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-dd1ec232-5b4b-4c65-a876-2292bc5de09f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1322 microversion: 2.1 time: 0.202448 Nov 15 12:39:59.199535 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 39/74] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:58 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:39:59.379265 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-ad57015e-ca13-46fb-becd-0d0b8382c48f tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:59.379882 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-ad57015e-ca13-46fb-becd-0d0b8382c48f tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:59.381597 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-2c7341a1-75ca-426c-b08e-6c0ea4987a1d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:39:59.382239 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-2c7341a1-75ca-426c-b08e-6c0ea4987a1d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:39:59.388420 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2c7341a1-75ca-426c-b08e-6c0ea4987a1d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:59.388871 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2c7341a1-75ca-426c-b08e-6c0ea4987a1d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:59.389717 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2c7341a1-75ca-426c-b08e-6c0ea4987a1d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:59.390151 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2c7341a1-75ca-426c-b08e-6c0ea4987a1d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:59.393449 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ad57015e-ca13-46fb-becd-0d0b8382c48f tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:59.394257 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ad57015e-ca13-46fb-becd-0d0b8382c48f tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:59.395112 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ad57015e-ca13-46fb-becd-0d0b8382c48f tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:39:59.397598 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ad57015e-ca13-46fb-becd-0d0b8382c48f tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:39:59.475174 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-2c7341a1-75ca-426c-b08e-6c0ea4987a1d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:59.486226 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-2c7341a1-75ca-426c-b08e-6c0ea4987a1d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1295 microversion: 2.1 time: 0.108214 Nov 15 12:39:59.486866 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 40/75] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:59 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1295 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:39:59.633035 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-ad57015e-ca13-46fb-becd-0d0b8382c48f tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:39:59.647791 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-ad57015e-ca13-46fb-becd-0d0b8382c48f tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1315 microversion: 2.1 time: 0.270835 Nov 15 12:39:59.649278 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 36/76] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:39:59 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:00.216785 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-1723b606-33cb-4420-b627-3c05b2a36559 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:00.217384 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-1723b606-33cb-4420-b627-3c05b2a36559 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:00.223423 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1723b606-33cb-4420-b627-3c05b2a36559 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:00.223868 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1723b606-33cb-4420-b627-3c05b2a36559 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:00.224632 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1723b606-33cb-4420-b627-3c05b2a36559 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:00.225055 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1723b606-33cb-4420-b627-3c05b2a36559 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:00.366675 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-1723b606-33cb-4420-b627-3c05b2a36559 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:00.374174 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-1723b606-33cb-4420-b627-3c05b2a36559 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1322 microversion: 2.1 time: 0.161046 Nov 15 12:40:00.374742 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 41/77] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:00 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:00.503617 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-5f820b00-880f-46d3-b175-38917397bf0b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:00.504949 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-5f820b00-880f-46d3-b175-38917397bf0b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:00.517032 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5f820b00-880f-46d3-b175-38917397bf0b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:00.517497 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5f820b00-880f-46d3-b175-38917397bf0b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:00.518729 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5f820b00-880f-46d3-b175-38917397bf0b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:00.518887 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5f820b00-880f-46d3-b175-38917397bf0b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:00.586421 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-5f820b00-880f-46d3-b175-38917397bf0b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:00.595738 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-5f820b00-880f-46d3-b175-38917397bf0b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1295 microversion: 2.1 time: 0.096485 Nov 15 12:40:00.596327 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 37/78] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:00 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1295 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:00.665985 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e1b910c4-40e1-4778-9038-dd8592249012 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:00.666634 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e1b910c4-40e1-4778-9038-dd8592249012 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:00.674670 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e1b910c4-40e1-4778-9038-dd8592249012 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:00.675410 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e1b910c4-40e1-4778-9038-dd8592249012 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:00.676200 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e1b910c4-40e1-4778-9038-dd8592249012 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:00.676632 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e1b910c4-40e1-4778-9038-dd8592249012 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:00.831693 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e1b910c4-40e1-4778-9038-dd8592249012 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:00.838920 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e1b910c4-40e1-4778-9038-dd8592249012 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1315 microversion: 2.1 time: 0.176453 Nov 15 12:40:00.839428 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 42/79] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:00 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:01.393464 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-f7163fb7-4f04-4bf4-9127-b0f02b5ac125 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:01.394071 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-f7163fb7-4f04-4bf4-9127-b0f02b5ac125 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:01.400399 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f7163fb7-4f04-4bf4-9127-b0f02b5ac125 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:01.400940 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f7163fb7-4f04-4bf4-9127-b0f02b5ac125 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:01.401736 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f7163fb7-4f04-4bf4-9127-b0f02b5ac125 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:01.402167 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f7163fb7-4f04-4bf4-9127-b0f02b5ac125 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:01.546094 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-f7163fb7-4f04-4bf4-9127-b0f02b5ac125 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:01.553962 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-f7163fb7-4f04-4bf4-9127-b0f02b5ac125 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1322 microversion: 2.1 time: 0.165524 Nov 15 12:40:01.554623 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 38/80] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:01 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:01.614012 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-1bc85952-67b9-43d9-a5db-dcc0e717a31a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:01.614625 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-1bc85952-67b9-43d9-a5db-dcc0e717a31a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:01.620594 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1bc85952-67b9-43d9-a5db-dcc0e717a31a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:01.621044 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1bc85952-67b9-43d9-a5db-dcc0e717a31a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:01.621819 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1bc85952-67b9-43d9-a5db-dcc0e717a31a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:01.622250 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1bc85952-67b9-43d9-a5db-dcc0e717a31a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:01.682683 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-1bc85952-67b9-43d9-a5db-dcc0e717a31a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:01.691269 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-1bc85952-67b9-43d9-a5db-dcc0e717a31a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1295 microversion: 2.1 time: 0.081570 Nov 15 12:40:01.691852 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 43/81] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:01 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1295 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:01.855991 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-72dadec3-3003-4f86-bdae-22a2a496293b tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:01.856825 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-72dadec3-3003-4f86-bdae-22a2a496293b tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:01.863731 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-72dadec3-3003-4f86-bdae-22a2a496293b tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:01.864180 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-72dadec3-3003-4f86-bdae-22a2a496293b tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:01.864962 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-72dadec3-3003-4f86-bdae-22a2a496293b tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:01.865395 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-72dadec3-3003-4f86-bdae-22a2a496293b tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:01.995495 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-72dadec3-3003-4f86-bdae-22a2a496293b tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:02.002948 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-72dadec3-3003-4f86-bdae-22a2a496293b tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1315 microversion: 2.1 time: 0.150548 Nov 15 12:40:02.003506 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 39/82] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:01 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:02.572558 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-ae2f57a6-8575-4b32-a430-4b31805674cc tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:02.573285 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-ae2f57a6-8575-4b32-a430-4b31805674cc tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:02.580773 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ae2f57a6-8575-4b32-a430-4b31805674cc tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:02.581539 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ae2f57a6-8575-4b32-a430-4b31805674cc tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:02.582490 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ae2f57a6-8575-4b32-a430-4b31805674cc tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:02.582875 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ae2f57a6-8575-4b32-a430-4b31805674cc tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:02.712576 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-fc8d5d80-4e17-44de-ae7e-8d23f4627dc7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:02.713229 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-fc8d5d80-4e17-44de-ae7e-8d23f4627dc7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:02.724039 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fc8d5d80-4e17-44de-ae7e-8d23f4627dc7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:02.726385 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fc8d5d80-4e17-44de-ae7e-8d23f4627dc7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:02.727269 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fc8d5d80-4e17-44de-ae7e-8d23f4627dc7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:02.727923 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fc8d5d80-4e17-44de-ae7e-8d23f4627dc7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:02.768107 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-ae2f57a6-8575-4b32-a430-4b31805674cc tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:02.786832 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-ae2f57a6-8575-4b32-a430-4b31805674cc tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1322 microversion: 2.1 time: 0.209036 Nov 15 12:40:02.801146 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 44/83] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:02 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:02.834173 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-fc8d5d80-4e17-44de-ae7e-8d23f4627dc7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:02.841800 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-fc8d5d80-4e17-44de-ae7e-8d23f4627dc7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1295 microversion: 2.1 time: 0.133389 Nov 15 12:40:02.842368 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 40/84] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:02 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1295 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:03.019669 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-09c14fc5-ca2b-47e4-8a6f-3245dfa1e9bd tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:03.020277 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-09c14fc5-ca2b-47e4-8a6f-3245dfa1e9bd tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:03.037703 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-09c14fc5-ca2b-47e4-8a6f-3245dfa1e9bd tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:03.038588 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-09c14fc5-ca2b-47e4-8a6f-3245dfa1e9bd tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:03.039619 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-09c14fc5-ca2b-47e4-8a6f-3245dfa1e9bd tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:03.040213 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-09c14fc5-ca2b-47e4-8a6f-3245dfa1e9bd tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:03.227963 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-09c14fc5-ca2b-47e4-8a6f-3245dfa1e9bd tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:03.239838 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-09c14fc5-ca2b-47e4-8a6f-3245dfa1e9bd tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1315 microversion: 2.1 time: 0.221286 Nov 15 12:40:03.251370 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 45/85] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:03 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:03.259348 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-7b4d5eb4-82e2-458f-88eb-45c7c4a41bb7 tempest-VolumesTestJSON-1077059518 tempest-VolumesTestJSON-1077059518-project] Calling method '.version_select at 0x7f131bfa8e50>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:03.362213 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-7b4d5eb4-82e2-458f-88eb-45c7c4a41bb7 tempest-VolumesTestJSON-1077059518 tempest-VolumesTestJSON-1077059518-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/d786f94f-51be-4fec-a93a-4498b3f2f77b" status: 200 len: 351 microversion: 2.1 time: 0.107319 Nov 15 12:40:03.363090 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 41/86] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Nov 15 12:40:03 2021] GET /compute/v2.1/os-volumes/d786f94f-51be-4fec-a93a-4498b3f2f77b => generated 351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:40:03.375121 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-5bc57a41-daa8-4671-9b01-ac67c4fca802 tempest-VolumesTestJSON-1077059518 tempest-VolumesTestJSON-1077059518-project] Calling method '.version_select at 0x7f13206addc0>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:03.479289 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-5bc57a41-daa8-4671-9b01-ac67c4fca802 tempest-VolumesTestJSON-1077059518 tempest-VolumesTestJSON-1077059518-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.105898 Nov 15 12:40:03.479289 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 46/87] 10.222.0.43 () {58 vars in 1133 bytes} [Mon Nov 15 12:40:03 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:40:03.495181 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-fc0e9910-abf3-432c-a895-e564a5d2d260 tempest-VolumesTestJSON-1077059518 tempest-VolumesTestJSON-1077059518-project] Calling method '.version_select at 0x7f131b6d33a0>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:03.590973 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-fc0e9910-abf3-432c-a895-e564a5d2d260 tempest-VolumesTestJSON-1077059518 tempest-VolumesTestJSON-1077059518-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.099785 Nov 15 12:40:03.591542 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 42/88] 10.222.0.43 () {58 vars in 1148 bytes} [Mon Nov 15 12:40:03 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:40:03.603622 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-5d8a422b-616c-445b-a8e7-e9eff63cd9d2 tempest-VolumesTestJSON-1077059518 tempest-VolumesTestJSON-1077059518-project] Calling method '.version_select at 0x7f1320709c10>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:03.709414 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-5d8a422b-616c-445b-a8e7-e9eff63cd9d2 tempest-VolumesTestJSON-1077059518 tempest-VolumesTestJSON-1077059518-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.109255 Nov 15 12:40:03.710021 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 47/89] 10.222.0.43 () {58 vars in 1133 bytes} [Mon Nov 15 12:40:03 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:03.723942 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-d2561e46-815f-4d77-bd65-b390de2ac6cf tempest-VolumesTestJSON-1077059518 tempest-VolumesTestJSON-1077059518-project] Calling method '.version_select at 0x7f131b6f6b80>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:03.815480 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-cf099939-0399-47e0-b72b-3b7bc869ef54 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:03.816191 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-cf099939-0399-47e0-b72b-3b7bc869ef54 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:03.823687 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cf099939-0399-47e0-b72b-3b7bc869ef54 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:03.824603 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cf099939-0399-47e0-b72b-3b7bc869ef54 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:03.825957 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cf099939-0399-47e0-b72b-3b7bc869ef54 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:03.826574 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cf099939-0399-47e0-b72b-3b7bc869ef54 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:03.828073 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-d2561e46-815f-4d77-bd65-b390de2ac6cf tempest-VolumesTestJSON-1077059518 tempest-VolumesTestJSON-1077059518-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.109873 Nov 15 12:40:03.835779 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 43/90] 10.222.0.43 () {58 vars in 1166 bytes} [Mon Nov 15 12:40:03 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:40:03.893009 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-6fa1d8d6-2dac-4005-be68-ece65088d26f tempest-VolumesTestJSON-1077059518 tempest-VolumesTestJSON-1077059518-project] Calling method '.version_select at 0x7f131b6bd9d0>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:04.139683 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-cf099939-0399-47e0-b72b-3b7bc869ef54 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:04.150198 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-cf099939-0399-47e0-b72b-3b7bc869ef54 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1322 microversion: 2.1 time: 0.338809 Nov 15 12:40:04.154259 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 48/91] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:03 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1322 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:04.161833 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-5cb9e522-6126-4f83-a532-dcecd639acba tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:04.162453 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-5cb9e522-6126-4f83-a532-dcecd639acba tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:04.169385 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5cb9e522-6126-4f83-a532-dcecd639acba tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:04.170217 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5cb9e522-6126-4f83-a532-dcecd639acba tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:04.171631 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5cb9e522-6126-4f83-a532-dcecd639acba tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:04.172306 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5cb9e522-6126-4f83-a532-dcecd639acba tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:04.174372 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-6fa1d8d6-2dac-4005-be68-ece65088d26f tempest-VolumesTestJSON-1077059518 tempest-VolumesTestJSON-1077059518-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.336644 Nov 15 12:40:04.182810 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 44/92] 10.222.0.43 () {58 vars in 1169 bytes} [Mon Nov 15 12:40:03 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:40:04.191268 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-28f12b6e-975f-43b7-bc7a-95b466c8bfeb tempest-VolumesTestJSON-1077059518 tempest-VolumesTestJSON-1077059518-project] Calling method '.version_select at 0x7f131b6f6820>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:04.272010 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-5cb9e522-6126-4f83-a532-dcecd639acba tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:04.283630 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-5cb9e522-6126-4f83-a532-dcecd639acba tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1295 microversion: 2.1 time: 0.125487 Nov 15 12:40:04.284271 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 49/93] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:04 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1295 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:04.298949 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-23e868af-bdfe-4d66-9013-3842d8daa110 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:04.300525 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-23e868af-bdfe-4d66-9013-3842d8daa110 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:04.307087 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-23e868af-bdfe-4d66-9013-3842d8daa110 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:04.307755 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-23e868af-bdfe-4d66-9013-3842d8daa110 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:04.308703 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-23e868af-bdfe-4d66-9013-3842d8daa110 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:04.309283 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-23e868af-bdfe-4d66-9013-3842d8daa110 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:04.355837 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-28f12b6e-975f-43b7-bc7a-95b466c8bfeb tempest-VolumesTestJSON-1077059518 tempest-VolumesTestJSON-1077059518-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.168164 Nov 15 12:40:04.356569 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 45/94] 10.222.0.43 () {58 vars in 1154 bytes} [Mon Nov 15 12:40:04 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:40:04.380740 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-3148420f-7f19-4080-82ff-a6155f10069a tempest-VolumesTestJSON-1077059518 tempest-VolumesTestJSON-1077059518-project] Calling method '.version_select at 0x7f131b69cb80>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:04.515802 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-3148420f-7f19-4080-82ff-a6155f10069a tempest-VolumesTestJSON-1077059518 tempest-VolumesTestJSON-1077059518-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.148306 Nov 15 12:40:04.517297 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 46/95] 10.222.0.43 () {58 vars in 1187 bytes} [Mon Nov 15 12:40:04 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:40:04.521903 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-23e868af-bdfe-4d66-9013-3842d8daa110 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:04.533596 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-fd2d2b97-eeb9-44ac-8766-05ee61f1081d tempest-VolumesTestJSON-1077059518 tempest-VolumesTestJSON-1077059518-project] Calling method '.version_select at 0x7f131b6919d0>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:04.535654 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-23e868af-bdfe-4d66-9013-3842d8daa110 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1315 microversion: 2.1 time: 0.241142 Nov 15 12:40:04.538845 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 50/96] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:04 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:04.627918 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-fd2d2b97-eeb9-44ac-8766-05ee61f1081d tempest-VolumesTestJSON-1077059518 tempest-VolumesTestJSON-1077059518-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.101382 Nov 15 12:40:04.628599 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 47/97] 10.222.0.43 () {58 vars in 1154 bytes} [Mon Nov 15 12:40:04 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:05.169957 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-a49fb324-dcc1-46e0-bb2b-8286c30709c6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:05.170671 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-a49fb324-dcc1-46e0-bb2b-8286c30709c6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:05.177096 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a49fb324-dcc1-46e0-bb2b-8286c30709c6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:05.177562 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a49fb324-dcc1-46e0-bb2b-8286c30709c6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:05.178437 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a49fb324-dcc1-46e0-bb2b-8286c30709c6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:05.178747 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a49fb324-dcc1-46e0-bb2b-8286c30709c6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:05.301910 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-4834a9b4-8ffe-4f48-a6b1-10b31164ccbf tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:05.302751 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-4834a9b4-8ffe-4f48-a6b1-10b31164ccbf tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:05.309007 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4834a9b4-8ffe-4f48-a6b1-10b31164ccbf tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:05.309456 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4834a9b4-8ffe-4f48-a6b1-10b31164ccbf tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:05.310229 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4834a9b4-8ffe-4f48-a6b1-10b31164ccbf tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:05.310653 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4834a9b4-8ffe-4f48-a6b1-10b31164ccbf tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:05.318201 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-a49fb324-dcc1-46e0-bb2b-8286c30709c6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:05.325509 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-a49fb324-dcc1-46e0-bb2b-8286c30709c6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1322 microversion: 2.1 time: 0.159100 Nov 15 12:40:05.326262 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 51/98] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:05 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:05.373626 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-4834a9b4-8ffe-4f48-a6b1-10b31164ccbf tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:05.381179 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-4834a9b4-8ffe-4f48-a6b1-10b31164ccbf tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1295 microversion: 2.1 time: 0.084193 Nov 15 12:40:05.381742 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 48/99] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:05 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1295 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:40:05.556640 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-200beb39-f991-4ade-819b-73ae3ca6acea tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:05.557241 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-200beb39-f991-4ade-819b-73ae3ca6acea tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:05.563770 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-200beb39-f991-4ade-819b-73ae3ca6acea tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:05.564165 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-200beb39-f991-4ade-819b-73ae3ca6acea tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:05.565243 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-200beb39-f991-4ade-819b-73ae3ca6acea tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:05.565511 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-200beb39-f991-4ade-819b-73ae3ca6acea tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:05.707796 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-200beb39-f991-4ade-819b-73ae3ca6acea tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:05.715297 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-200beb39-f991-4ade-819b-73ae3ca6acea tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1315 microversion: 2.1 time: 0.162178 Nov 15 12:40:05.715956 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 52/100] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:05 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:06.342749 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-1d87baa4-c250-4c76-8b94-2fc97718a250 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:06.343377 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-1d87baa4-c250-4c76-8b94-2fc97718a250 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:06.349584 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1d87baa4-c250-4c76-8b94-2fc97718a250 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:06.350032 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1d87baa4-c250-4c76-8b94-2fc97718a250 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:06.350862 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1d87baa4-c250-4c76-8b94-2fc97718a250 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:06.351303 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1d87baa4-c250-4c76-8b94-2fc97718a250 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:06.397512 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-bb22bf9c-2f73-4bb4-9276-0157297b36dd tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:06.398219 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-bb22bf9c-2f73-4bb4-9276-0157297b36dd tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:06.404103 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bb22bf9c-2f73-4bb4-9276-0157297b36dd tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:06.404611 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bb22bf9c-2f73-4bb4-9276-0157297b36dd tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:06.405461 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bb22bf9c-2f73-4bb4-9276-0157297b36dd tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:06.405953 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bb22bf9c-2f73-4bb4-9276-0157297b36dd tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:06.475741 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-bb22bf9c-2f73-4bb4-9276-0157297b36dd tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:06.483009 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-bb22bf9c-2f73-4bb4-9276-0157297b36dd tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1295 microversion: 2.1 time: 0.089041 Nov 15 12:40:06.483591 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 53/101] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:06 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1295 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:40:06.510113 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-1d87baa4-c250-4c76-8b94-2fc97718a250 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:06.518207 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-1d87baa4-c250-4c76-8b94-2fc97718a250 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1322 microversion: 2.1 time: 0.179132 Nov 15 12:40:06.518781 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 49/102] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:06 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:06.732631 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-0bd7fbb1-d90d-4253-a0eb-cbdbd95c78a4 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:06.733144 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-0bd7fbb1-d90d-4253-a0eb-cbdbd95c78a4 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:06.739615 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0bd7fbb1-d90d-4253-a0eb-cbdbd95c78a4 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:06.740048 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0bd7fbb1-d90d-4253-a0eb-cbdbd95c78a4 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:06.740808 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0bd7fbb1-d90d-4253-a0eb-cbdbd95c78a4 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:06.741230 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0bd7fbb1-d90d-4253-a0eb-cbdbd95c78a4 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:06.873499 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-0bd7fbb1-d90d-4253-a0eb-cbdbd95c78a4 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:06.881222 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-0bd7fbb1-d90d-4253-a0eb-cbdbd95c78a4 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1315 microversion: 2.1 time: 0.152260 Nov 15 12:40:06.881795 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 54/103] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:06 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:07.499812 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-7337196f-7441-4381-a737-a0c1354ae066 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:07.501480 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-7337196f-7441-4381-a737-a0c1354ae066 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:07.507453 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7337196f-7441-4381-a737-a0c1354ae066 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:07.507901 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7337196f-7441-4381-a737-a0c1354ae066 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:07.508674 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7337196f-7441-4381-a737-a0c1354ae066 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:07.509107 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7337196f-7441-4381-a737-a0c1354ae066 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:07.535122 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-b8f9cd4d-f6a1-4f7e-8772-2e5912984a7a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:07.535923 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-b8f9cd4d-f6a1-4f7e-8772-2e5912984a7a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:07.541863 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b8f9cd4d-f6a1-4f7e-8772-2e5912984a7a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:07.542307 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b8f9cd4d-f6a1-4f7e-8772-2e5912984a7a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:07.543128 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b8f9cd4d-f6a1-4f7e-8772-2e5912984a7a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:07.543561 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b8f9cd4d-f6a1-4f7e-8772-2e5912984a7a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:07.572664 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-7337196f-7441-4381-a737-a0c1354ae066 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:07.580472 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-7337196f-7441-4381-a737-a0c1354ae066 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1295 microversion: 2.1 time: 0.084275 Nov 15 12:40:07.581068 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 50/104] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:07 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1295 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:07.677953 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-b8f9cd4d-f6a1-4f7e-8772-2e5912984a7a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:07.685541 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-b8f9cd4d-f6a1-4f7e-8772-2e5912984a7a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1322 microversion: 2.1 time: 0.154614 Nov 15 12:40:07.686109 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 55/105] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:07 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:40:07.899848 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-064967f2-0c60-4aec-85d7-144dc4b06aa8 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:07.900491 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-064967f2-0c60-4aec-85d7-144dc4b06aa8 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:07.911568 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-064967f2-0c60-4aec-85d7-144dc4b06aa8 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:07.912500 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-064967f2-0c60-4aec-85d7-144dc4b06aa8 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:07.913896 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-064967f2-0c60-4aec-85d7-144dc4b06aa8 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:07.914485 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-064967f2-0c60-4aec-85d7-144dc4b06aa8 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:08.115713 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-064967f2-0c60-4aec-85d7-144dc4b06aa8 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:08.123284 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-064967f2-0c60-4aec-85d7-144dc4b06aa8 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1315 microversion: 2.1 time: 0.227551 Nov 15 12:40:08.123851 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 51/106] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:07 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:08.600412 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e8b94a9d-e393-403f-a75b-5f6a44fd65ac tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:08.601215 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e8b94a9d-e393-403f-a75b-5f6a44fd65ac tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:08.612899 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e8b94a9d-e393-403f-a75b-5f6a44fd65ac tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:08.614324 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e8b94a9d-e393-403f-a75b-5f6a44fd65ac tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:08.618965 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e8b94a9d-e393-403f-a75b-5f6a44fd65ac tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:08.618965 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e8b94a9d-e393-403f-a75b-5f6a44fd65ac tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:08.703119 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-8db2e171-c960-42e2-8a1c-046ff2c54c2f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:08.704816 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-8db2e171-c960-42e2-8a1c-046ff2c54c2f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:08.711878 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8db2e171-c960-42e2-8a1c-046ff2c54c2f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:08.712596 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8db2e171-c960-42e2-8a1c-046ff2c54c2f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:08.713728 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8db2e171-c960-42e2-8a1c-046ff2c54c2f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:08.714663 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8db2e171-c960-42e2-8a1c-046ff2c54c2f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:08.727809 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e8b94a9d-e393-403f-a75b-5f6a44fd65ac tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:08.738509 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e8b94a9d-e393-403f-a75b-5f6a44fd65ac tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1295 microversion: 2.1 time: 0.142855 Nov 15 12:40:08.739572 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 56/107] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:08 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1295 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:08.921570 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-8db2e171-c960-42e2-8a1c-046ff2c54c2f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:08.932916 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-8db2e171-c960-42e2-8a1c-046ff2c54c2f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1322 microversion: 2.1 time: 0.234049 Nov 15 12:40:08.933515 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 52/108] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:08 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:40:09.142152 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-4ca71e9a-05ac-4df0-9903-94ae61efd520 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:09.143018 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-4ca71e9a-05ac-4df0-9903-94ae61efd520 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:09.149223 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4ca71e9a-05ac-4df0-9903-94ae61efd520 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:09.149551 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4ca71e9a-05ac-4df0-9903-94ae61efd520 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:09.150401 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4ca71e9a-05ac-4df0-9903-94ae61efd520 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:09.150866 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4ca71e9a-05ac-4df0-9903-94ae61efd520 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:09.301551 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-4ca71e9a-05ac-4df0-9903-94ae61efd520 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:09.309397 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-4ca71e9a-05ac-4df0-9903-94ae61efd520 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1315 microversion: 2.1 time: 0.171715 Nov 15 12:40:09.310067 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 57/109] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:09 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:09.756100 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-246cfe1b-1eb3-4e15-a63b-d8546773a31b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:09.756952 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-246cfe1b-1eb3-4e15-a63b-d8546773a31b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:09.763030 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-246cfe1b-1eb3-4e15-a63b-d8546773a31b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:09.763476 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-246cfe1b-1eb3-4e15-a63b-d8546773a31b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:09.764421 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-246cfe1b-1eb3-4e15-a63b-d8546773a31b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:09.764927 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-246cfe1b-1eb3-4e15-a63b-d8546773a31b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:09.914914 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [req-795e35ed-a780-4d09-91c2-932d3097f30e req-3b66053c-c087-494f-b82b-581c0713f211 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aea00c4f-da8f-4b9e-8c12-7ebe91776986", "tag": "15072390-eca0-4c84-8a3a-2ea1b15c4f44"}]} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:40:09.917946 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:40:09.917946 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: warnings.warn(msg) Nov 15 12:40:09.921308 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-246cfe1b-1eb3-4e15-a63b-d8546773a31b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:09.929565 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-246cfe1b-1eb3-4e15-a63b-d8546773a31b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1363 microversion: 2.1 time: 0.177412 Nov 15 12:40:09.930369 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 53/110] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:09 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:09.930528 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-795e35ed-a780-4d09-91c2-932d3097f30e req-3b66053c-c087-494f-b82b-581c0713f211 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:09.930933 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-795e35ed-a780-4d09-91c2-932d3097f30e req-3b66053c-c087-494f-b82b-581c0713f211 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:09.942041 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.compute.server_external_events [req-795e35ed-a780-4d09-91c2-932d3097f30e req-3b66053c-c087-494f-b82b-581c0713f211 service nova] Creating event network-changed:15072390-eca0-4c84-8a3a-2ea1b15c4f44 for instance aea00c4f-da8f-4b9e-8c12-7ebe91776986 on hv-cinder-68088 Nov 15 12:40:09.946916 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [req-795e35ed-a780-4d09-91c2-932d3097f30e req-3b66053c-c087-494f-b82b-581c0713f211 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104494 Nov 15 12:40:09.947430 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 58/111] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:40:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 15 12:40:09.953989 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-73a2e546-fc14-48e2-9298-5720edad2654 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:09.955243 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-73a2e546-fc14-48e2-9298-5720edad2654 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:09.961119 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-73a2e546-fc14-48e2-9298-5720edad2654 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:09.961564 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-73a2e546-fc14-48e2-9298-5720edad2654 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:09.962362 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-73a2e546-fc14-48e2-9298-5720edad2654 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:09.962821 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-73a2e546-fc14-48e2-9298-5720edad2654 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:10.103448 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-73a2e546-fc14-48e2-9298-5720edad2654 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:10.111762 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-73a2e546-fc14-48e2-9298-5720edad2654 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1322 microversion: 2.1 time: 0.162221 Nov 15 12:40:10.112628 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 54/112] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:09 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:10.327433 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-c3d811d0-e6e6-4851-a9c8-2f7924a4e727 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:10.328120 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-c3d811d0-e6e6-4851-a9c8-2f7924a4e727 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:10.334442 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c3d811d0-e6e6-4851-a9c8-2f7924a4e727 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:10.334972 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c3d811d0-e6e6-4851-a9c8-2f7924a4e727 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:10.335744 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c3d811d0-e6e6-4851-a9c8-2f7924a4e727 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:10.336205 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c3d811d0-e6e6-4851-a9c8-2f7924a4e727 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:10.465452 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-c3d811d0-e6e6-4851-a9c8-2f7924a4e727 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:10.475545 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-c3d811d0-e6e6-4851-a9c8-2f7924a4e727 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1315 microversion: 2.1 time: 0.151947 Nov 15 12:40:10.476126 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 59/113] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:10 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:10.948499 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-5a66440b-ce3e-4bdb-b138-dadade283766 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:10.949137 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-5a66440b-ce3e-4bdb-b138-dadade283766 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:10.955422 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5a66440b-ce3e-4bdb-b138-dadade283766 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:10.955857 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5a66440b-ce3e-4bdb-b138-dadade283766 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:10.956617 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5a66440b-ce3e-4bdb-b138-dadade283766 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:10.957037 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5a66440b-ce3e-4bdb-b138-dadade283766 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:11.093014 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-5a66440b-ce3e-4bdb-b138-dadade283766 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:11.101326 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-5a66440b-ce3e-4bdb-b138-dadade283766 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1363 microversion: 2.1 time: 0.155894 Nov 15 12:40:11.101636 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 55/114] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:10 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:11.128716 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-71db8bf7-06ec-4773-b172-dc077bc35e5a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:11.129320 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-71db8bf7-06ec-4773-b172-dc077bc35e5a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:11.135238 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-71db8bf7-06ec-4773-b172-dc077bc35e5a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:11.135686 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-71db8bf7-06ec-4773-b172-dc077bc35e5a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:11.136487 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-71db8bf7-06ec-4773-b172-dc077bc35e5a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:11.136918 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-71db8bf7-06ec-4773-b172-dc077bc35e5a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:11.282401 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-71db8bf7-06ec-4773-b172-dc077bc35e5a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:11.289923 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-71db8bf7-06ec-4773-b172-dc077bc35e5a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1322 microversion: 2.1 time: 0.164883 Nov 15 12:40:11.290502 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 60/115] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:11 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:11.493700 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-2ae5637e-55fa-4996-a61e-03af4db37a91 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:11.494237 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-2ae5637e-55fa-4996-a61e-03af4db37a91 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:11.504217 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2ae5637e-55fa-4996-a61e-03af4db37a91 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:11.504217 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2ae5637e-55fa-4996-a61e-03af4db37a91 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:11.504217 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2ae5637e-55fa-4996-a61e-03af4db37a91 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:11.504217 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2ae5637e-55fa-4996-a61e-03af4db37a91 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:11.633832 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-2ae5637e-55fa-4996-a61e-03af4db37a91 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:11.641469 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-2ae5637e-55fa-4996-a61e-03af4db37a91 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1315 microversion: 2.1 time: 0.151088 Nov 15 12:40:11.642038 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 56/116] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:11 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:11.973382 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [req-7259fc3a-e96b-454b-8d38-432cd6c1e406 req-cc29fbfb-ffcf-4bd3-b88b-1d65b32030f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c319b68-dfab-4fb6-99df-31bb18385b5c", "tag": "f4c16b05-8781-451a-9351-681a5be81f6d"}]} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:40:11.975534 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:40:11.975534 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: warnings.warn(msg) Nov 15 12:40:11.982881 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-7259fc3a-e96b-454b-8d38-432cd6c1e406 req-cc29fbfb-ffcf-4bd3-b88b-1d65b32030f5 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:11.983322 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-7259fc3a-e96b-454b-8d38-432cd6c1e406 req-cc29fbfb-ffcf-4bd3-b88b-1d65b32030f5 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:11.998502 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.compute.server_external_events [req-7259fc3a-e96b-454b-8d38-432cd6c1e406 req-cc29fbfb-ffcf-4bd3-b88b-1d65b32030f5 service nova] Creating event network-changed:f4c16b05-8781-451a-9351-681a5be81f6d for instance 3c319b68-dfab-4fb6-99df-31bb18385b5c on hv-cinder-68088 Nov 15 12:40:12.004493 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [req-7259fc3a-e96b-454b-8d38-432cd6c1e406 req-cc29fbfb-ffcf-4bd3-b88b-1d65b32030f5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036675 Nov 15 12:40:12.005102 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 61/117] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:40:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:40:12.119872 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-a907b01a-567d-4a09-966b-6a42eedbd8a4 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:12.120651 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-a907b01a-567d-4a09-966b-6a42eedbd8a4 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:12.127865 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a907b01a-567d-4a09-966b-6a42eedbd8a4 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:12.128354 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a907b01a-567d-4a09-966b-6a42eedbd8a4 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:12.129146 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a907b01a-567d-4a09-966b-6a42eedbd8a4 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:12.129578 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a907b01a-567d-4a09-966b-6a42eedbd8a4 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:12.306110 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-a907b01a-567d-4a09-966b-6a42eedbd8a4 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:12.308750 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-9e84d979-4c92-4fb3-98bc-7030e550d1e6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:12.309555 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-9e84d979-4c92-4fb3-98bc-7030e550d1e6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:12.314494 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-a907b01a-567d-4a09-966b-6a42eedbd8a4 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1363 microversion: 2.1 time: 0.198730 Nov 15 12:40:12.315112 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 57/118] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:12 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:12.316839 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9e84d979-4c92-4fb3-98bc-7030e550d1e6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:12.317292 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9e84d979-4c92-4fb3-98bc-7030e550d1e6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:12.318083 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9e84d979-4c92-4fb3-98bc-7030e550d1e6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:12.318513 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9e84d979-4c92-4fb3-98bc-7030e550d1e6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:12.461155 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-9e84d979-4c92-4fb3-98bc-7030e550d1e6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:12.469787 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-9e84d979-4c92-4fb3-98bc-7030e550d1e6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1322 microversion: 2.1 time: 0.164424 Nov 15 12:40:12.470836 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 62/119] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:12 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:12.657871 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-f152955c-864d-403b-b080-b3845b5b1970 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:12.658481 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-f152955c-864d-403b-b080-b3845b5b1970 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:12.665081 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f152955c-864d-403b-b080-b3845b5b1970 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:12.665528 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f152955c-864d-403b-b080-b3845b5b1970 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:12.666314 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f152955c-864d-403b-b080-b3845b5b1970 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:12.667068 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f152955c-864d-403b-b080-b3845b5b1970 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:12.827860 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-f152955c-864d-403b-b080-b3845b5b1970 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:12.837270 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-f152955c-864d-403b-b080-b3845b5b1970 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1315 microversion: 2.1 time: 0.183666 Nov 15 12:40:12.847671 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 58/120] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:12 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:13.333717 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-0586d4a2-cdc7-4d5f-a6f8-3a25824418c8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:13.335725 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-0586d4a2-cdc7-4d5f-a6f8-3a25824418c8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:13.345651 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0586d4a2-cdc7-4d5f-a6f8-3a25824418c8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:13.346480 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0586d4a2-cdc7-4d5f-a6f8-3a25824418c8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:13.347583 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0586d4a2-cdc7-4d5f-a6f8-3a25824418c8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:13.348341 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0586d4a2-cdc7-4d5f-a6f8-3a25824418c8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:13.489724 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-c49be1b7-1bba-4592-ad7a-174c5e3cc577 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:13.489724 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-c49be1b7-1bba-4592-ad7a-174c5e3cc577 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:13.495726 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c49be1b7-1bba-4592-ad7a-174c5e3cc577 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:13.496538 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c49be1b7-1bba-4592-ad7a-174c5e3cc577 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:13.497561 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c49be1b7-1bba-4592-ad7a-174c5e3cc577 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:13.497946 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c49be1b7-1bba-4592-ad7a-174c5e3cc577 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:13.516173 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-0586d4a2-cdc7-4d5f-a6f8-3a25824418c8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:13.523523 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-0586d4a2-cdc7-4d5f-a6f8-3a25824418c8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1363 microversion: 2.1 time: 0.195558 Nov 15 12:40:13.524097 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 63/121] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:13 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:13.634626 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-c49be1b7-1bba-4592-ad7a-174c5e3cc577 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:13.642310 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-c49be1b7-1bba-4592-ad7a-174c5e3cc577 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1322 microversion: 2.1 time: 0.158980 Nov 15 12:40:13.642878 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 59/122] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:13 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:40:13.855902 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-433ec93c-9cf4-4548-8bd3-2508eaecf6b2 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:13.856451 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-433ec93c-9cf4-4548-8bd3-2508eaecf6b2 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:13.862667 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-433ec93c-9cf4-4548-8bd3-2508eaecf6b2 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:13.863140 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-433ec93c-9cf4-4548-8bd3-2508eaecf6b2 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:13.863903 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-433ec93c-9cf4-4548-8bd3-2508eaecf6b2 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:13.864319 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-433ec93c-9cf4-4548-8bd3-2508eaecf6b2 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:13.997716 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-433ec93c-9cf4-4548-8bd3-2508eaecf6b2 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:14.005990 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-433ec93c-9cf4-4548-8bd3-2508eaecf6b2 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1315 microversion: 2.1 time: 0.154051 Nov 15 12:40:14.006560 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 64/123] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:13 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:14.036563 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-d0c922ea-4470-451e-8084-d0c1356b8b13 req-9b3bfe3b-bb65-490d-b2d0-bf486bc08a3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a107064a-524f-4964-97da-84d2b50d422d", "tag": "bb0f4a9a-c9a8-4d3c-b1a8-f21dae3f8b8a"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:40:14.038699 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:40:14.038699 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:40:14.048907 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-d0c922ea-4470-451e-8084-d0c1356b8b13 req-9b3bfe3b-bb65-490d-b2d0-bf486bc08a3f service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:14.049341 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-d0c922ea-4470-451e-8084-d0c1356b8b13 req-9b3bfe3b-bb65-490d-b2d0-bf486bc08a3f service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:14.068487 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-d0c922ea-4470-451e-8084-d0c1356b8b13 req-9b3bfe3b-bb65-490d-b2d0-bf486bc08a3f service nova] Creating event network-changed:bb0f4a9a-c9a8-4d3c-b1a8-f21dae3f8b8a for instance a107064a-524f-4964-97da-84d2b50d422d on hv-cinder-68088 Nov 15 12:40:14.069005 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-d0c922ea-4470-451e-8084-d0c1356b8b13 req-9b3bfe3b-bb65-490d-b2d0-bf486bc08a3f service nova] Acquired lock "compute-rpcapi-router" {{(pid=122568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 15 12:40:14.070092 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-af7301f5-8cdf-47ac-96c4-a27d9c7887aa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:14.070529 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-af7301f5-8cdf-47ac-96c4-a27d9c7887aa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:14.071348 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-af7301f5-8cdf-47ac-96c4-a27d9c7887aa None None] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:14.071776 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-af7301f5-8cdf-47ac-96c4-a27d9c7887aa None None] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:14.080860 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.compute.rpcapi [None req-af7301f5-8cdf-47ac-96c4-a27d9c7887aa None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 15 12:40:14.081719 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-af7301f5-8cdf-47ac-96c4-a27d9c7887aa None None] Releasing lock "compute-rpcapi-router" {{(pid=122568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 15 12:40:14.105134 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-af7301f5-8cdf-47ac-96c4-a27d9c7887aa None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072863 Nov 15 12:40:14.105725 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 60/124] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:40:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 15 12:40:14.540395 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-c6ec534c-ce38-46d8-a0e0-2d70d44a7f43 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:14.541148 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-c6ec534c-ce38-46d8-a0e0-2d70d44a7f43 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:14.547688 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c6ec534c-ce38-46d8-a0e0-2d70d44a7f43 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:14.548224 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c6ec534c-ce38-46d8-a0e0-2d70d44a7f43 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:14.549004 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c6ec534c-ce38-46d8-a0e0-2d70d44a7f43 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:14.549465 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c6ec534c-ce38-46d8-a0e0-2d70d44a7f43 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:14.659460 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-0deeb908-1012-4a6e-a80d-5878392ab129 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:14.660228 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-0deeb908-1012-4a6e-a80d-5878392ab129 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:14.666381 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0deeb908-1012-4a6e-a80d-5878392ab129 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:14.666849 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0deeb908-1012-4a6e-a80d-5878392ab129 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:14.667748 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0deeb908-1012-4a6e-a80d-5878392ab129 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:14.668178 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0deeb908-1012-4a6e-a80d-5878392ab129 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:14.682847 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-c6ec534c-ce38-46d8-a0e0-2d70d44a7f43 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:14.691458 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-c6ec534c-ce38-46d8-a0e0-2d70d44a7f43 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1363 microversion: 2.1 time: 0.154643 Nov 15 12:40:14.692041 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 65/125] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:14 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:14.802850 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-0deeb908-1012-4a6e-a80d-5878392ab129 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:14.810015 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-0deeb908-1012-4a6e-a80d-5878392ab129 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1322 microversion: 2.1 time: 0.155447 Nov 15 12:40:14.810570 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 61/126] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:14 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:40:15.023588 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-ecbabefc-bf2e-425c-b829-f3e8c99fc6af tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:15.024226 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-ecbabefc-bf2e-425c-b829-f3e8c99fc6af tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:15.030443 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ecbabefc-bf2e-425c-b829-f3e8c99fc6af tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:15.030917 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ecbabefc-bf2e-425c-b829-f3e8c99fc6af tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:15.031833 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ecbabefc-bf2e-425c-b829-f3e8c99fc6af tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:15.032558 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ecbabefc-bf2e-425c-b829-f3e8c99fc6af tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:15.169796 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-ecbabefc-bf2e-425c-b829-f3e8c99fc6af tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:15.178097 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-ecbabefc-bf2e-425c-b829-f3e8c99fc6af tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1315 microversion: 2.1 time: 0.158351 Nov 15 12:40:15.178686 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 66/127] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:15 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:15.710246 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-6eaef8ec-5d87-458e-b441-d6c53ee973a8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:15.711042 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-6eaef8ec-5d87-458e-b441-d6c53ee973a8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:15.718141 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6eaef8ec-5d87-458e-b441-d6c53ee973a8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:15.718586 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6eaef8ec-5d87-458e-b441-d6c53ee973a8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:15.720092 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6eaef8ec-5d87-458e-b441-d6c53ee973a8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:15.720519 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6eaef8ec-5d87-458e-b441-d6c53ee973a8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:15.827068 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-48c148d7-1c19-47d8-b9cc-9e5752a6956c tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:15.827883 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-48c148d7-1c19-47d8-b9cc-9e5752a6956c tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:15.834315 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-48c148d7-1c19-47d8-b9cc-9e5752a6956c tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:15.834751 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-48c148d7-1c19-47d8-b9cc-9e5752a6956c tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:15.835549 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-48c148d7-1c19-47d8-b9cc-9e5752a6956c tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:15.835968 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-48c148d7-1c19-47d8-b9cc-9e5752a6956c tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:15.857549 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-6eaef8ec-5d87-458e-b441-d6c53ee973a8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:15.865801 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-6eaef8ec-5d87-458e-b441-d6c53ee973a8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1363 microversion: 2.1 time: 0.160777 Nov 15 12:40:15.866372 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 62/128] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:15 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:40:15.967630 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-48c148d7-1c19-47d8-b9cc-9e5752a6956c tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:15.974894 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-48c148d7-1c19-47d8-b9cc-9e5752a6956c tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1322 microversion: 2.1 time: 0.151423 Nov 15 12:40:15.975465 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 67/129] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:15 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:40:16.194830 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-01de5e80-ad82-49d5-a5e1-753e49eaea75 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:16.195428 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-01de5e80-ad82-49d5-a5e1-753e49eaea75 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:16.201369 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-01de5e80-ad82-49d5-a5e1-753e49eaea75 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:16.201810 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-01de5e80-ad82-49d5-a5e1-753e49eaea75 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:16.202676 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-01de5e80-ad82-49d5-a5e1-753e49eaea75 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:16.203135 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-01de5e80-ad82-49d5-a5e1-753e49eaea75 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:16.334119 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-01de5e80-ad82-49d5-a5e1-753e49eaea75 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:16.341374 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-01de5e80-ad82-49d5-a5e1-753e49eaea75 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1315 microversion: 2.1 time: 0.150215 Nov 15 12:40:16.341938 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 63/130] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:16 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:16.882128 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-cc0bea62-61d5-4c23-9163-f0ea7591c973 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:16.882646 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-cc0bea62-61d5-4c23-9163-f0ea7591c973 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:16.888615 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cc0bea62-61d5-4c23-9163-f0ea7591c973 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:16.889095 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cc0bea62-61d5-4c23-9163-f0ea7591c973 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:16.889855 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cc0bea62-61d5-4c23-9163-f0ea7591c973 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:16.890287 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cc0bea62-61d5-4c23-9163-f0ea7591c973 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:16.991141 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-cc60a9da-4722-486a-8662-9db67a620ee3 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:16.991742 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-cc60a9da-4722-486a-8662-9db67a620ee3 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:16.997867 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-cc60a9da-4722-486a-8662-9db67a620ee3 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:16.998309 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-cc60a9da-4722-486a-8662-9db67a620ee3 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:16.999103 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-cc60a9da-4722-486a-8662-9db67a620ee3 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:16.999527 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-cc60a9da-4722-486a-8662-9db67a620ee3 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:17.030573 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-cc0bea62-61d5-4c23-9163-f0ea7591c973 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:17.042299 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-cc0bea62-61d5-4c23-9163-f0ea7591c973 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1363 microversion: 2.1 time: 0.163866 Nov 15 12:40:17.042905 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 68/131] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:16 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:17.133683 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-cc60a9da-4722-486a-8662-9db67a620ee3 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:17.140955 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-cc60a9da-4722-486a-8662-9db67a620ee3 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1322 microversion: 2.1 time: 0.153477 Nov 15 12:40:17.141519 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 64/132] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:16 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:40:17.358061 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-65bc4a4a-7221-4f36-9eb9-1003d672e26a tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:17.358664 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-65bc4a4a-7221-4f36-9eb9-1003d672e26a tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:17.365416 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-65bc4a4a-7221-4f36-9eb9-1003d672e26a tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:17.365864 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-65bc4a4a-7221-4f36-9eb9-1003d672e26a tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:17.366644 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-65bc4a4a-7221-4f36-9eb9-1003d672e26a tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:17.367116 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-65bc4a4a-7221-4f36-9eb9-1003d672e26a tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:17.501398 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-65bc4a4a-7221-4f36-9eb9-1003d672e26a tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:17.508814 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-65bc4a4a-7221-4f36-9eb9-1003d672e26a tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1315 microversion: 2.1 time: 0.154367 Nov 15 12:40:17.509397 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 69/133] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:17 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:18.065691 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-e7677871-aca2-4d14-9db8-aab697542867 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:18.066242 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-e7677871-aca2-4d14-9db8-aab697542867 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:18.072549 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e7677871-aca2-4d14-9db8-aab697542867 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:18.073002 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e7677871-aca2-4d14-9db8-aab697542867 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:18.073785 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e7677871-aca2-4d14-9db8-aab697542867 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:18.074218 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e7677871-aca2-4d14-9db8-aab697542867 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:18.158036 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-654ce754-b6a4-4296-98d4-cf8355f82659 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:18.158630 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-654ce754-b6a4-4296-98d4-cf8355f82659 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:18.164995 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-654ce754-b6a4-4296-98d4-cf8355f82659 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:18.165472 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-654ce754-b6a4-4296-98d4-cf8355f82659 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:18.166258 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-654ce754-b6a4-4296-98d4-cf8355f82659 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:18.166694 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-654ce754-b6a4-4296-98d4-cf8355f82659 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:18.217544 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-e7677871-aca2-4d14-9db8-aab697542867 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:18.225631 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-e7677871-aca2-4d14-9db8-aab697542867 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1363 microversion: 2.1 time: 0.164028 Nov 15 12:40:18.226299 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 65/134] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:18 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:18.302916 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-654ce754-b6a4-4296-98d4-cf8355f82659 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:18.310389 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-654ce754-b6a4-4296-98d4-cf8355f82659 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1322 microversion: 2.1 time: 0.156821 Nov 15 12:40:18.311022 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 70/135] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:18 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:40:18.525061 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-c075418f-9edc-48b3-9d21-1416a909bede tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:18.525894 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-c075418f-9edc-48b3-9d21-1416a909bede tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:18.536488 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c075418f-9edc-48b3-9d21-1416a909bede tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:18.537018 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c075418f-9edc-48b3-9d21-1416a909bede tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:18.537916 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c075418f-9edc-48b3-9d21-1416a909bede tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:18.538344 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c075418f-9edc-48b3-9d21-1416a909bede tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:18.688280 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-c075418f-9edc-48b3-9d21-1416a909bede tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:18.695800 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-c075418f-9edc-48b3-9d21-1416a909bede tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1315 microversion: 2.1 time: 0.174221 Nov 15 12:40:18.696509 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 66/136] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:18 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:19.242619 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-b4badc14-7abe-41c3-8ad3-c4be80f30f29 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:19.243421 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-b4badc14-7abe-41c3-8ad3-c4be80f30f29 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:19.249465 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b4badc14-7abe-41c3-8ad3-c4be80f30f29 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:19.249914 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b4badc14-7abe-41c3-8ad3-c4be80f30f29 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:19.251800 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b4badc14-7abe-41c3-8ad3-c4be80f30f29 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:19.252608 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b4badc14-7abe-41c3-8ad3-c4be80f30f29 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:19.364217 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-f882378f-e41b-4cd7-9940-30bd3f45a926 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:19.364923 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-f882378f-e41b-4cd7-9940-30bd3f45a926 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:19.371970 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f882378f-e41b-4cd7-9940-30bd3f45a926 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:19.372427 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f882378f-e41b-4cd7-9940-30bd3f45a926 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:19.373417 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f882378f-e41b-4cd7-9940-30bd3f45a926 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:19.374125 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f882378f-e41b-4cd7-9940-30bd3f45a926 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:19.409266 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-b4badc14-7abe-41c3-8ad3-c4be80f30f29 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:19.417762 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-b4badc14-7abe-41c3-8ad3-c4be80f30f29 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1363 microversion: 2.1 time: 0.178797 Nov 15 12:40:19.419348 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 71/137] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:19 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:19.527925 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-f882378f-e41b-4cd7-9940-30bd3f45a926 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:19.536252 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-f882378f-e41b-4cd7-9940-30bd3f45a926 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1322 microversion: 2.1 time: 0.177095 Nov 15 12:40:19.536833 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 67/138] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:19 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:19.713803 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-c163fa0e-fc88-47a3-816f-c7ecc909517f tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:19.714406 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-c163fa0e-fc88-47a3-816f-c7ecc909517f tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:19.721054 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c163fa0e-fc88-47a3-816f-c7ecc909517f tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:19.721508 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c163fa0e-fc88-47a3-816f-c7ecc909517f tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:19.722308 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c163fa0e-fc88-47a3-816f-c7ecc909517f tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:19.722725 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c163fa0e-fc88-47a3-816f-c7ecc909517f tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:19.934090 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-c163fa0e-fc88-47a3-816f-c7ecc909517f tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:19.943551 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-c163fa0e-fc88-47a3-816f-c7ecc909517f tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1315 microversion: 2.1 time: 0.232894 Nov 15 12:40:19.945701 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 72/139] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:19 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:20.435826 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-840fadc1-af7b-4809-989e-4bdafa75a1f6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:20.436541 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-840fadc1-af7b-4809-989e-4bdafa75a1f6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:20.444480 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-840fadc1-af7b-4809-989e-4bdafa75a1f6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:20.445605 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-840fadc1-af7b-4809-989e-4bdafa75a1f6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:20.447047 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-840fadc1-af7b-4809-989e-4bdafa75a1f6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:20.447755 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-840fadc1-af7b-4809-989e-4bdafa75a1f6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:20.558952 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-54d87bbe-bdce-4780-8b3c-229273929c72 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:20.560185 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-54d87bbe-bdce-4780-8b3c-229273929c72 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:20.573253 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-54d87bbe-bdce-4780-8b3c-229273929c72 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:20.574107 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-54d87bbe-bdce-4780-8b3c-229273929c72 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:20.575390 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-54d87bbe-bdce-4780-8b3c-229273929c72 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:20.575894 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-54d87bbe-bdce-4780-8b3c-229273929c72 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:20.744119 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-840fadc1-af7b-4809-989e-4bdafa75a1f6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:20.756920 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-840fadc1-af7b-4809-989e-4bdafa75a1f6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1363 microversion: 2.1 time: 0.324729 Nov 15 12:40:20.758685 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 68/140] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:20 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1363 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:20.894115 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-54d87bbe-bdce-4780-8b3c-229273929c72 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:20.907921 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-54d87bbe-bdce-4780-8b3c-229273929c72 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1322 microversion: 2.1 time: 0.356983 Nov 15 12:40:20.909247 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 73/141] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:20 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1322 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:40:20.961751 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-074f8c1a-17b9-4dd5-8fff-a1521bf297aa tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:20.962483 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-074f8c1a-17b9-4dd5-8fff-a1521bf297aa tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:20.969879 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-074f8c1a-17b9-4dd5-8fff-a1521bf297aa tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:20.970406 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-074f8c1a-17b9-4dd5-8fff-a1521bf297aa tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:20.971241 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-074f8c1a-17b9-4dd5-8fff-a1521bf297aa tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:20.971662 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-074f8c1a-17b9-4dd5-8fff-a1521bf297aa tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:21.122426 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-074f8c1a-17b9-4dd5-8fff-a1521bf297aa tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:21.130949 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-074f8c1a-17b9-4dd5-8fff-a1521bf297aa tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1315 microversion: 2.1 time: 0.172953 Nov 15 12:40:21.131565 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 69/142] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:20 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:21.776147 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-d7305614-b10e-413f-bd65-43d65cac776a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:21.776969 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-d7305614-b10e-413f-bd65-43d65cac776a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:21.783855 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d7305614-b10e-413f-bd65-43d65cac776a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:21.784301 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d7305614-b10e-413f-bd65-43d65cac776a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:21.785087 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d7305614-b10e-413f-bd65-43d65cac776a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:21.785521 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d7305614-b10e-413f-bd65-43d65cac776a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:21.927663 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-1e1bd355-8ee0-42d9-b374-c65202b576f6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:21.928263 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-1e1bd355-8ee0-42d9-b374-c65202b576f6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:21.937764 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1e1bd355-8ee0-42d9-b374-c65202b576f6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:21.938948 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1e1bd355-8ee0-42d9-b374-c65202b576f6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:21.940035 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1e1bd355-8ee0-42d9-b374-c65202b576f6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:21.940621 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1e1bd355-8ee0-42d9-b374-c65202b576f6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:21.948633 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-d7305614-b10e-413f-bd65-43d65cac776a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:21.956860 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-d7305614-b10e-413f-bd65-43d65cac776a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1363 microversion: 2.1 time: 0.184572 Nov 15 12:40:21.957748 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 74/143] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:21 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:40:22.143208 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-1e1bd355-8ee0-42d9-b374-c65202b576f6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:22.149253 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-d52da866-77c6-4e4c-bb31-9de750066491 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:22.149944 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-d52da866-77c6-4e4c-bb31-9de750066491 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:22.155466 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-1e1bd355-8ee0-42d9-b374-c65202b576f6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1322 microversion: 2.1 time: 0.232737 Nov 15 12:40:22.156816 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 70/144] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:21 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:22.159706 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d52da866-77c6-4e4c-bb31-9de750066491 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:22.160395 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d52da866-77c6-4e4c-bb31-9de750066491 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:22.161243 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d52da866-77c6-4e4c-bb31-9de750066491 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:22.161755 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d52da866-77c6-4e4c-bb31-9de750066491 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:22.348587 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-d52da866-77c6-4e4c-bb31-9de750066491 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:22.363963 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-d52da866-77c6-4e4c-bb31-9de750066491 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1315 microversion: 2.1 time: 0.219412 Nov 15 12:40:22.364629 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 75/145] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:22 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:22.973615 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-65f94fca-5f63-4f29-8911-5bd96f6f5796 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:22.974325 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-65f94fca-5f63-4f29-8911-5bd96f6f5796 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:22.982422 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-65f94fca-5f63-4f29-8911-5bd96f6f5796 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:22.984673 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-65f94fca-5f63-4f29-8911-5bd96f6f5796 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:22.987221 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-65f94fca-5f63-4f29-8911-5bd96f6f5796 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:22.988946 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-65f94fca-5f63-4f29-8911-5bd96f6f5796 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:23.173761 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-a700f9b9-8473-4949-bbef-a9a58de7ad2b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:23.175427 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-a700f9b9-8473-4949-bbef-a9a58de7ad2b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:23.186211 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a700f9b9-8473-4949-bbef-a9a58de7ad2b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:23.186924 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a700f9b9-8473-4949-bbef-a9a58de7ad2b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:23.188458 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a700f9b9-8473-4949-bbef-a9a58de7ad2b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:23.190745 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a700f9b9-8473-4949-bbef-a9a58de7ad2b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:23.230204 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-65f94fca-5f63-4f29-8911-5bd96f6f5796 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:23.240500 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-65f94fca-5f63-4f29-8911-5bd96f6f5796 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1363 microversion: 2.1 time: 0.270271 Nov 15 12:40:23.242585 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 71/146] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:22 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1363 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:23.383180 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-ff6e2b0b-5097-4b08-a22a-a96f05df4a29 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:23.383347 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-a700f9b9-8473-4949-bbef-a9a58de7ad2b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:23.384011 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-ff6e2b0b-5097-4b08-a22a-a96f05df4a29 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:23.392757 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-a700f9b9-8473-4949-bbef-a9a58de7ad2b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1322 microversion: 2.1 time: 0.223094 Nov 15 12:40:23.394083 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 76/147] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:23 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:23.396084 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ff6e2b0b-5097-4b08-a22a-a96f05df4a29 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:23.396609 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ff6e2b0b-5097-4b08-a22a-a96f05df4a29 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:23.397481 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ff6e2b0b-5097-4b08-a22a-a96f05df4a29 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:23.399346 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ff6e2b0b-5097-4b08-a22a-a96f05df4a29 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:23.543200 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-ff6e2b0b-5097-4b08-a22a-a96f05df4a29 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:23.551564 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-ff6e2b0b-5097-4b08-a22a-a96f05df4a29 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1315 microversion: 2.1 time: 0.173632 Nov 15 12:40:23.561030 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 72/148] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:23 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:40:24.259726 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-66b51de0-886b-4928-b1e5-2327d64aaca2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:24.262936 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-66b51de0-886b-4928-b1e5-2327d64aaca2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:24.276916 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-66b51de0-886b-4928-b1e5-2327d64aaca2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:24.277828 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-66b51de0-886b-4928-b1e5-2327d64aaca2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:24.279011 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-66b51de0-886b-4928-b1e5-2327d64aaca2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:24.280163 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-66b51de0-886b-4928-b1e5-2327d64aaca2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:24.410826 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-84f4438a-873f-4f89-8259-923cc2995c9d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:24.411411 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-84f4438a-873f-4f89-8259-923cc2995c9d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:24.421516 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-84f4438a-873f-4f89-8259-923cc2995c9d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:24.422459 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-84f4438a-873f-4f89-8259-923cc2995c9d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:24.424130 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-84f4438a-873f-4f89-8259-923cc2995c9d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:24.426689 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-84f4438a-873f-4f89-8259-923cc2995c9d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:24.463469 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-66b51de0-886b-4928-b1e5-2327d64aaca2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:24.494895 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-66b51de0-886b-4928-b1e5-2327d64aaca2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1363 microversion: 2.1 time: 0.241121 Nov 15 12:40:24.499516 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 77/149] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:24 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:24.582915 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e794a640-145d-441f-a0fe-a2c38dba178a tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:24.586403 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e794a640-145d-441f-a0fe-a2c38dba178a tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:24.600929 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e794a640-145d-441f-a0fe-a2c38dba178a tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:24.606570 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e794a640-145d-441f-a0fe-a2c38dba178a tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:24.609140 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e794a640-145d-441f-a0fe-a2c38dba178a tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:24.611255 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e794a640-145d-441f-a0fe-a2c38dba178a tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:24.708103 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-84f4438a-873f-4f89-8259-923cc2995c9d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:24.728919 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-84f4438a-873f-4f89-8259-923cc2995c9d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1322 microversion: 2.1 time: 0.322569 Nov 15 12:40:24.735499 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 73/150] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:24 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:24.904320 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e794a640-145d-441f-a0fe-a2c38dba178a tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:24.913085 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e794a640-145d-441f-a0fe-a2c38dba178a tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1315 microversion: 2.1 time: 0.345537 Nov 15 12:40:24.913879 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 78/151] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:24 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:25.516946 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-28fb0fca-59bb-48d1-a5a4-fa58fc021e84 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:25.517800 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-28fb0fca-59bb-48d1-a5a4-fa58fc021e84 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:25.524265 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-28fb0fca-59bb-48d1-a5a4-fa58fc021e84 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:25.524717 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-28fb0fca-59bb-48d1-a5a4-fa58fc021e84 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:25.525564 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-28fb0fca-59bb-48d1-a5a4-fa58fc021e84 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:25.525997 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-28fb0fca-59bb-48d1-a5a4-fa58fc021e84 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:25.753796 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-c311d90a-7acf-4d96-9175-c82a4de6eeac tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:25.754753 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-c311d90a-7acf-4d96-9175-c82a4de6eeac tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:25.761468 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c311d90a-7acf-4d96-9175-c82a4de6eeac tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:25.761911 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c311d90a-7acf-4d96-9175-c82a4de6eeac tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:25.762926 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c311d90a-7acf-4d96-9175-c82a4de6eeac tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:25.763761 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c311d90a-7acf-4d96-9175-c82a4de6eeac tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:25.866594 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-28fb0fca-59bb-48d1-a5a4-fa58fc021e84 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:25.876064 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-28fb0fca-59bb-48d1-a5a4-fa58fc021e84 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1363 microversion: 2.1 time: 0.363386 Nov 15 12:40:25.876646 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 74/152] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:25 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1363 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:25.934935 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-c311d90a-7acf-4d96-9175-c82a4de6eeac tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:25.938117 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-40d6608c-7939-4182-b844-165dc48793e6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:25.938732 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-40d6608c-7939-4182-b844-165dc48793e6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:25.948389 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-c311d90a-7acf-4d96-9175-c82a4de6eeac tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1322 microversion: 2.1 time: 0.199080 Nov 15 12:40:25.948979 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 79/153] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:25 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:40:25.950556 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-40d6608c-7939-4182-b844-165dc48793e6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:25.951226 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-40d6608c-7939-4182-b844-165dc48793e6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:25.952220 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-40d6608c-7939-4182-b844-165dc48793e6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:25.952829 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-40d6608c-7939-4182-b844-165dc48793e6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:26.103523 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-40d6608c-7939-4182-b844-165dc48793e6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:26.112432 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-40d6608c-7939-4182-b844-165dc48793e6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1315 microversion: 2.1 time: 0.183569 Nov 15 12:40:26.113427 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 75/154] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:25 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:26.657178 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [req-6323e679-1f41-4370-846b-6e5094a09154 req-cad15c6a-28a4-493b-ab1a-5b851543ab81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10b7dd7b-ae59-4375-b46b-47dacaf4be62", "name": "network-vif-plugged", "status": "completed", "tag": "6b8d7663-6fa5-48c7-b3b3-f2a4a7d6782e"}]} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:40:26.658857 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:40:26.658857 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: warnings.warn(msg) Nov 15 12:40:26.669874 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-6323e679-1f41-4370-846b-6e5094a09154 req-cad15c6a-28a4-493b-ab1a-5b851543ab81 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:26.673264 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-6323e679-1f41-4370-846b-6e5094a09154 req-cad15c6a-28a4-493b-ab1a-5b851543ab81 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:26.694207 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.compute.server_external_events [req-6323e679-1f41-4370-846b-6e5094a09154 req-cad15c6a-28a4-493b-ab1a-5b851543ab81 service nova] Creating event network-vif-plugged:6b8d7663-6fa5-48c7-b3b3-f2a4a7d6782e for instance 10b7dd7b-ae59-4375-b46b-47dacaf4be62 on hv-cinder-68088 Nov 15 12:40:26.704507 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [req-6323e679-1f41-4370-846b-6e5094a09154 req-cad15c6a-28a4-493b-ab1a-5b851543ab81 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160024 Nov 15 12:40:26.705677 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 80/155] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:40:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 15 12:40:26.896600 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-632d1aec-e623-42a9-8839-592befff97e5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:26.897716 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-632d1aec-e623-42a9-8839-592befff97e5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:26.905896 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-632d1aec-e623-42a9-8839-592befff97e5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:26.906843 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-632d1aec-e623-42a9-8839-592befff97e5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:26.908026 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-632d1aec-e623-42a9-8839-592befff97e5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:26.908697 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-632d1aec-e623-42a9-8839-592befff97e5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:26.967536 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-1ba46b23-8620-4857-9b85-d559b2380343 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:26.970291 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-1ba46b23-8620-4857-9b85-d559b2380343 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:26.986126 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1ba46b23-8620-4857-9b85-d559b2380343 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:26.986954 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1ba46b23-8620-4857-9b85-d559b2380343 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:26.990325 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1ba46b23-8620-4857-9b85-d559b2380343 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:26.991109 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1ba46b23-8620-4857-9b85-d559b2380343 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:27.147205 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-632d1aec-e623-42a9-8839-592befff97e5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:27.155686 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-632d1aec-e623-42a9-8839-592befff97e5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1363 microversion: 2.1 time: 0.265919 Nov 15 12:40:27.166347 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 76/156] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:26 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:27.186011 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-742f1ef7-f944-480d-9ccb-f8ae6c3903c3 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:27.187028 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-742f1ef7-f944-480d-9ccb-f8ae6c3903c3 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:27.202313 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-742f1ef7-f944-480d-9ccb-f8ae6c3903c3 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:27.203554 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-742f1ef7-f944-480d-9ccb-f8ae6c3903c3 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:27.204496 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-742f1ef7-f944-480d-9ccb-f8ae6c3903c3 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:27.205062 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-742f1ef7-f944-480d-9ccb-f8ae6c3903c3 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:27.282338 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-1ba46b23-8620-4857-9b85-d559b2380343 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:27.294348 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-1ba46b23-8620-4857-9b85-d559b2380343 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1322 microversion: 2.1 time: 0.332461 Nov 15 12:40:27.295510 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 81/157] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:26 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1322 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:27.464964 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-742f1ef7-f944-480d-9ccb-f8ae6c3903c3 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:27.474648 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-742f1ef7-f944-480d-9ccb-f8ae6c3903c3 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1315 microversion: 2.1 time: 0.306778 Nov 15 12:40:27.475304 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 77/158] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:27 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:28.175093 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-90e6b979-8e4b-429e-b5e4-c97d152b8ab5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:28.175786 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-90e6b979-8e4b-429e-b5e4-c97d152b8ab5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:28.183704 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-90e6b979-8e4b-429e-b5e4-c97d152b8ab5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:28.184524 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-90e6b979-8e4b-429e-b5e4-c97d152b8ab5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:28.185473 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-90e6b979-8e4b-429e-b5e4-c97d152b8ab5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:28.186112 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-90e6b979-8e4b-429e-b5e4-c97d152b8ab5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:28.311567 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-9cb6940a-7776-4c8b-ad45-5c558bc521a3 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:28.313397 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-9cb6940a-7776-4c8b-ad45-5c558bc521a3 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:28.326537 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9cb6940a-7776-4c8b-ad45-5c558bc521a3 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:28.327661 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9cb6940a-7776-4c8b-ad45-5c558bc521a3 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:28.330468 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9cb6940a-7776-4c8b-ad45-5c558bc521a3 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:28.331383 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9cb6940a-7776-4c8b-ad45-5c558bc521a3 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:28.373348 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-90e6b979-8e4b-429e-b5e4-c97d152b8ab5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:28.382591 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-90e6b979-8e4b-429e-b5e4-c97d152b8ab5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1363 microversion: 2.1 time: 0.212976 Nov 15 12:40:28.383825 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 82/159] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:28 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:28.491338 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-9660160a-d942-4a70-82e3-0c0c680b7c98 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:28.492582 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-9660160a-d942-4a70-82e3-0c0c680b7c98 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:28.497486 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-9cb6940a-7776-4c8b-ad45-5c558bc521a3 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:28.499134 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9660160a-d942-4a70-82e3-0c0c680b7c98 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:28.499657 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9660160a-d942-4a70-82e3-0c0c680b7c98 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:28.501461 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9660160a-d942-4a70-82e3-0c0c680b7c98 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:28.502214 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9660160a-d942-4a70-82e3-0c0c680b7c98 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:28.522657 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-9cb6940a-7776-4c8b-ad45-5c558bc521a3 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1322 microversion: 2.1 time: 0.207146 Nov 15 12:40:28.523520 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 78/160] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:28 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:28.655094 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-9660160a-d942-4a70-82e3-0c0c680b7c98 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:28.668539 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-9660160a-d942-4a70-82e3-0c0c680b7c98 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1315 microversion: 2.1 time: 0.180756 Nov 15 12:40:28.669166 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 83/161] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:28 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:28.723256 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-e912500d-b80a-4a75-82a9-592acf8c9706 req-e8d3e0c1-2b9b-41c1-8c8c-1cb9f46e1816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a107064a-524f-4964-97da-84d2b50d422d", "name": "network-vif-plugged", "status": "completed", "tag": "bb0f4a9a-c9a8-4d3c-b1a8-f21dae3f8b8a"}, {"server_uuid": "aea00c4f-da8f-4b9e-8c12-7ebe91776986", "name": "network-vif-plugged", "status": "completed", "tag": "15072390-eca0-4c84-8a3a-2ea1b15c4f44"}, {"server_uuid": "3c319b68-dfab-4fb6-99df-31bb18385b5c", "name": "network-vif-plugged", "status": "completed", "tag": "f4c16b05-8781-451a-9351-681a5be81f6d"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:40:28.726136 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:40:28.726136 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:40:28.735332 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-e912500d-b80a-4a75-82a9-592acf8c9706 req-e8d3e0c1-2b9b-41c1-8c8c-1cb9f46e1816 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:28.736004 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-e912500d-b80a-4a75-82a9-592acf8c9706 req-e8d3e0c1-2b9b-41c1-8c8c-1cb9f46e1816 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:28.751561 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-e912500d-b80a-4a75-82a9-592acf8c9706 req-e8d3e0c1-2b9b-41c1-8c8c-1cb9f46e1816 service nova] Creating event network-vif-plugged:bb0f4a9a-c9a8-4d3c-b1a8-f21dae3f8b8a for instance a107064a-524f-4964-97da-84d2b50d422d on hv-cinder-68088 Nov 15 12:40:28.752412 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-e912500d-b80a-4a75-82a9-592acf8c9706 req-e8d3e0c1-2b9b-41c1-8c8c-1cb9f46e1816 service nova] Creating event network-vif-plugged:15072390-eca0-4c84-8a3a-2ea1b15c4f44 for instance aea00c4f-da8f-4b9e-8c12-7ebe91776986 on hv-cinder-68088 Nov 15 12:40:28.752897 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-e912500d-b80a-4a75-82a9-592acf8c9706 req-e8d3e0c1-2b9b-41c1-8c8c-1cb9f46e1816 service nova] Creating event network-vif-plugged:f4c16b05-8781-451a-9351-681a5be81f6d for instance 3c319b68-dfab-4fb6-99df-31bb18385b5c on hv-cinder-68088 Nov 15 12:40:28.761234 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-e912500d-b80a-4a75-82a9-592acf8c9706 req-e8d3e0c1-2b9b-41c1-8c8c-1cb9f46e1816 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.042710 Nov 15 12:40:28.763742 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 79/162] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:40:28 2021] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:40:29.402194 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-83d0ff0b-5100-44ec-9485-d8ea87df5f97 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:29.402992 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-83d0ff0b-5100-44ec-9485-d8ea87df5f97 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:29.411789 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-83d0ff0b-5100-44ec-9485-d8ea87df5f97 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:29.412533 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-83d0ff0b-5100-44ec-9485-d8ea87df5f97 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:29.413679 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-83d0ff0b-5100-44ec-9485-d8ea87df5f97 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:29.414346 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-83d0ff0b-5100-44ec-9485-d8ea87df5f97 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:29.553069 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-bd44dca8-2bb7-4400-9bff-dc9673aae4c5 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:29.553837 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-bd44dca8-2bb7-4400-9bff-dc9673aae4c5 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:29.589013 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bd44dca8-2bb7-4400-9bff-dc9673aae4c5 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:29.589678 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bd44dca8-2bb7-4400-9bff-dc9673aae4c5 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:29.598369 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bd44dca8-2bb7-4400-9bff-dc9673aae4c5 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:29.598924 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bd44dca8-2bb7-4400-9bff-dc9673aae4c5 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:29.704239 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-83d0ff0b-5100-44ec-9485-d8ea87df5f97 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:29.712862 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-83d0ff0b-5100-44ec-9485-d8ea87df5f97 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1363 microversion: 2.1 time: 0.316353 Nov 15 12:40:29.723075 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 84/163] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:29 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1363 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:29.723075 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-b21e1dec-feeb-4ef4-acfa-c84ec9f86912 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:29.723075 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-b21e1dec-feeb-4ef4-acfa-c84ec9f86912 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:29.736243 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b21e1dec-feeb-4ef4-acfa-c84ec9f86912 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:29.736733 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b21e1dec-feeb-4ef4-acfa-c84ec9f86912 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:29.737550 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b21e1dec-feeb-4ef4-acfa-c84ec9f86912 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:29.737972 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b21e1dec-feeb-4ef4-acfa-c84ec9f86912 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:29.964322 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-bd44dca8-2bb7-4400-9bff-dc9673aae4c5 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:29.977036 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-bd44dca8-2bb7-4400-9bff-dc9673aae4c5 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1322 microversion: 2.1 time: 0.437501 Nov 15 12:40:29.977631 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 80/164] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:29 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1322 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:30.036708 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-b21e1dec-feeb-4ef4-acfa-c84ec9f86912 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:30.047163 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-b21e1dec-feeb-4ef4-acfa-c84ec9f86912 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1315 microversion: 2.1 time: 0.331423 Nov 15 12:40:30.048432 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 85/165] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:29 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:30.732832 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-bff596b2-db4f-4e4d-94f4-b3a9b955ca42 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:30.734215 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-bff596b2-db4f-4e4d-94f4-b3a9b955ca42 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:30.766021 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bff596b2-db4f-4e4d-94f4-b3a9b955ca42 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:30.767500 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bff596b2-db4f-4e4d-94f4-b3a9b955ca42 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:30.773196 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bff596b2-db4f-4e4d-94f4-b3a9b955ca42 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:30.775426 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bff596b2-db4f-4e4d-94f4-b3a9b955ca42 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:30.993812 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-d7bdda0b-776f-4b98-a25e-4b4f1a9ea46b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:30.994445 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-d7bdda0b-776f-4b98-a25e-4b4f1a9ea46b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:31.000939 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d7bdda0b-776f-4b98-a25e-4b4f1a9ea46b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:31.001968 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d7bdda0b-776f-4b98-a25e-4b4f1a9ea46b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:31.003045 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d7bdda0b-776f-4b98-a25e-4b4f1a9ea46b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:31.003744 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d7bdda0b-776f-4b98-a25e-4b4f1a9ea46b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:31.003854 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-bff596b2-db4f-4e4d-94f4-b3a9b955ca42 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:31.019213 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-bff596b2-db4f-4e4d-94f4-b3a9b955ca42 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1363 microversion: 2.1 time: 0.292258 Nov 15 12:40:31.020886 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 81/166] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:30 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1363 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:31.065566 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-9567834b-a449-4eaa-92bf-68ea5b1b5816 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:31.066577 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-9567834b-a449-4eaa-92bf-68ea5b1b5816 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:31.074987 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9567834b-a449-4eaa-92bf-68ea5b1b5816 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:31.075541 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9567834b-a449-4eaa-92bf-68ea5b1b5816 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:31.076431 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9567834b-a449-4eaa-92bf-68ea5b1b5816 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:31.077250 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9567834b-a449-4eaa-92bf-68ea5b1b5816 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:31.312095 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-d7bdda0b-776f-4b98-a25e-4b4f1a9ea46b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:31.323809 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-d7bdda0b-776f-4b98-a25e-4b4f1a9ea46b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1322 microversion: 2.1 time: 0.332553 Nov 15 12:40:31.335797 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 86/167] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:30 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1322 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:31.346333 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-9567834b-a449-4eaa-92bf-68ea5b1b5816 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:31.354468 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-9567834b-a449-4eaa-92bf-68ea5b1b5816 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1315 microversion: 2.1 time: 0.293342 Nov 15 12:40:31.355212 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 82/168] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:31 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:40:32.040222 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-87799928-2c12-4b3e-8758-426f2aca9937 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:32.040820 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-87799928-2c12-4b3e-8758-426f2aca9937 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:32.047798 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-87799928-2c12-4b3e-8758-426f2aca9937 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:32.048250 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-87799928-2c12-4b3e-8758-426f2aca9937 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:32.049040 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-87799928-2c12-4b3e-8758-426f2aca9937 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:32.049726 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-87799928-2c12-4b3e-8758-426f2aca9937 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:32.255254 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-87799928-2c12-4b3e-8758-426f2aca9937 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:32.263258 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-87799928-2c12-4b3e-8758-426f2aca9937 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1363 microversion: 2.1 time: 0.229659 Nov 15 12:40:32.263779 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 87/169] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:32 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:32.341636 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-f59b5160-be2d-4cb8-9e3b-bddf03e5fc08 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:32.342943 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-f59b5160-be2d-4cb8-9e3b-bddf03e5fc08 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:32.349684 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f59b5160-be2d-4cb8-9e3b-bddf03e5fc08 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:32.350141 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f59b5160-be2d-4cb8-9e3b-bddf03e5fc08 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:32.351114 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f59b5160-be2d-4cb8-9e3b-bddf03e5fc08 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:32.351542 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f59b5160-be2d-4cb8-9e3b-bddf03e5fc08 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:32.372432 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-bb1eb9f0-ff60-4c74-9675-0c171270e4c6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:32.373032 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-bb1eb9f0-ff60-4c74-9675-0c171270e4c6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:32.381003 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bb1eb9f0-ff60-4c74-9675-0c171270e4c6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:32.382675 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bb1eb9f0-ff60-4c74-9675-0c171270e4c6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:32.385505 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bb1eb9f0-ff60-4c74-9675-0c171270e4c6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:32.386094 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bb1eb9f0-ff60-4c74-9675-0c171270e4c6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:32.619650 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-f59b5160-be2d-4cb8-9e3b-bddf03e5fc08 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:32.631247 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-f59b5160-be2d-4cb8-9e3b-bddf03e5fc08 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1322 microversion: 2.1 time: 0.293505 Nov 15 12:40:32.632582 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 83/170] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:32 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:32.665930 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-bb1eb9f0-ff60-4c74-9675-0c171270e4c6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:32.675857 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-bb1eb9f0-ff60-4c74-9675-0c171270e4c6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1315 microversion: 2.1 time: 0.306947 Nov 15 12:40:32.676408 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 88/171] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:32 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:33.288190 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-3ec42a9d-8eac-4663-a694-0c2e96b3fb85 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:33.294681 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-3ec42a9d-8eac-4663-a694-0c2e96b3fb85 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:33.320198 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3ec42a9d-8eac-4663-a694-0c2e96b3fb85 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:33.322105 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3ec42a9d-8eac-4663-a694-0c2e96b3fb85 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:33.322956 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3ec42a9d-8eac-4663-a694-0c2e96b3fb85 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:33.323388 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3ec42a9d-8eac-4663-a694-0c2e96b3fb85 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:33.650429 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-33bcd000-7775-48d9-a33e-aaf4326f8828 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:33.651089 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-33bcd000-7775-48d9-a33e-aaf4326f8828 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:33.660692 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-33bcd000-7775-48d9-a33e-aaf4326f8828 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:33.661281 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-33bcd000-7775-48d9-a33e-aaf4326f8828 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:33.662170 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-33bcd000-7775-48d9-a33e-aaf4326f8828 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:33.662717 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-33bcd000-7775-48d9-a33e-aaf4326f8828 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:33.676676 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-3ec42a9d-8eac-4663-a694-0c2e96b3fb85 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:33.687632 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-3ec42a9d-8eac-4663-a694-0c2e96b3fb85 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1363 microversion: 2.1 time: 0.409556 Nov 15 12:40:33.689054 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 84/172] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:33 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1363 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:33.697986 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-24127ae9-c6dd-4100-a05e-05307373fbd4 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:33.699732 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-24127ae9-c6dd-4100-a05e-05307373fbd4 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:33.721146 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-24127ae9-c6dd-4100-a05e-05307373fbd4 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:33.721956 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-24127ae9-c6dd-4100-a05e-05307373fbd4 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:33.722965 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-24127ae9-c6dd-4100-a05e-05307373fbd4 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:33.725873 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-24127ae9-c6dd-4100-a05e-05307373fbd4 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:34.112932 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-33bcd000-7775-48d9-a33e-aaf4326f8828 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:34.124275 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-33bcd000-7775-48d9-a33e-aaf4326f8828 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1322 microversion: 2.1 time: 0.478760 Nov 15 12:40:34.128681 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-24127ae9-c6dd-4100-a05e-05307373fbd4 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:34.135836 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 89/173] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:33 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1322 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:34.137828 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-24127ae9-c6dd-4100-a05e-05307373fbd4 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1502 microversion: 2.1 time: 0.446120 Nov 15 12:40:34.138607 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 85/174] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:33 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1502 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:34.712546 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-ca55ab7f-16eb-47f8-a9c4-0504dd177344 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:34.713164 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-ca55ab7f-16eb-47f8-a9c4-0504dd177344 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:34.728348 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ca55ab7f-16eb-47f8-a9c4-0504dd177344 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:34.728972 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ca55ab7f-16eb-47f8-a9c4-0504dd177344 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:34.729910 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ca55ab7f-16eb-47f8-a9c4-0504dd177344 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:34.730550 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ca55ab7f-16eb-47f8-a9c4-0504dd177344 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:34.984148 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-ca55ab7f-16eb-47f8-a9c4-0504dd177344 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:34.997144 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-ca55ab7f-16eb-47f8-a9c4-0504dd177344 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1549 microversion: 2.1 time: 0.294221 Nov 15 12:40:35.009758 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 90/175] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:34 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1549 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:35.017493 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-499691a8-d707-4bc8-9d56-420658857217 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:35.018055 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-499691a8-d707-4bc8-9d56-420658857217 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:35.032825 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-499691a8-d707-4bc8-9d56-420658857217 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:35.033269 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-499691a8-d707-4bc8-9d56-420658857217 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:35.034066 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-499691a8-d707-4bc8-9d56-420658857217 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:35.034501 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-499691a8-d707-4bc8-9d56-420658857217 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:35.146861 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-b7f17945-fc04-47b9-8edc-f9bd3e123629 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:35.147603 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-b7f17945-fc04-47b9-8edc-f9bd3e123629 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:35.159308 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b7f17945-fc04-47b9-8edc-f9bd3e123629 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:35.160252 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b7f17945-fc04-47b9-8edc-f9bd3e123629 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:35.161288 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b7f17945-fc04-47b9-8edc-f9bd3e123629 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:35.161932 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b7f17945-fc04-47b9-8edc-f9bd3e123629 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:35.244598 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-499691a8-d707-4bc8-9d56-420658857217 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.231739 Nov 15 12:40:35.245414 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 86/176] 10.222.0.43 () {58 vars in 1274 bytes} [Mon Nov 15 12:40:35 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/os-interface => generated 285 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:40:35.451313 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-b7f17945-fc04-47b9-8edc-f9bd3e123629 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:35.461424 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-b7f17945-fc04-47b9-8edc-f9bd3e123629 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1516 microversion: 2.1 time: 0.321213 Nov 15 12:40:35.462307 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 91/177] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:35 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1516 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:35.479998 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-43395e2c-7742-428a-a673-dc788e926e08 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:40:35.481154 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-43395e2c-7742-428a-a673-dc788e926e08 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:35.491464 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-43395e2c-7742-428a-a673-dc788e926e08 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:35.491923 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-43395e2c-7742-428a-a673-dc788e926e08 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:35.494230 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-43395e2c-7742-428a-a673-dc788e926e08 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:35.496124 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-43395e2c-7742-428a-a673-dc788e926e08 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:35.534295 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.objects.instance [None req-43395e2c-7742-428a-a673-dc788e926e08 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lazy-loading 'flavor' on Instance uuid 3c319b68-dfab-4fb6-99df-31bb18385b5c {{(pid=122568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 15 12:40:35.752331 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-43395e2c-7742-428a-a673-dc788e926e08 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "POST /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c/action" status: 200 len: 32 microversion: 2.1 time: 0.276095 Nov 15 12:40:35.753938 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 87/178] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:40:35 2021] POST /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c/action => generated 32 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 15 12:40:35.764377 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-f2c31ac7-aa80-4243-bfac-b96098445d55 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:35.768069 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-f2c31ac7-aa80-4243-bfac-b96098445d55 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:35.776601 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f2c31ac7-aa80-4243-bfac-b96098445d55 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:35.777699 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f2c31ac7-aa80-4243-bfac-b96098445d55 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:35.779051 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f2c31ac7-aa80-4243-bfac-b96098445d55 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:35.780135 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f2c31ac7-aa80-4243-bfac-b96098445d55 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:35.892711 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-a2ea1cc5-5101-4e7a-9e0f-4fb4fc38541a tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f092232-c8f2-43b1-b9d2-bea263ca3ec9"}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:40:35.896297 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-a2ea1cc5-5101-4e7a-9e0f-4fb4fc38541a tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:35.919321 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a2ea1cc5-5101-4e7a-9e0f-4fb4fc38541a tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:35.921086 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a2ea1cc5-5101-4e7a-9e0f-4fb4fc38541a tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:35.925791 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a2ea1cc5-5101-4e7a-9e0f-4fb4fc38541a tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:35.929414 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a2ea1cc5-5101-4e7a-9e0f-4fb4fc38541a tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:36.400466 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-a2ea1cc5-5101-4e7a-9e0f-4fb4fc38541a tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "POST /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.512578 Nov 15 12:40:36.402009 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 88/179] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Nov 15 12:40:35 2021] POST /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62/os-volume_attachments => generated 194 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 15 12:40:36.521329 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-f2c31ac7-aa80-4243-bfac-b96098445d55 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:36.534480 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-f2c31ac7-aa80-4243-bfac-b96098445d55 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.775645 Nov 15 12:40:36.550338 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 92/180] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:35 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:40:37.564221 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-95af8d8e-492c-4969-8bee-e870d761c3b6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:37.567153 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-95af8d8e-492c-4969-8bee-e870d761c3b6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:37.584620 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-95af8d8e-492c-4969-8bee-e870d761c3b6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:37.584620 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-95af8d8e-492c-4969-8bee-e870d761c3b6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:37.592719 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-95af8d8e-492c-4969-8bee-e870d761c3b6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:37.593188 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-95af8d8e-492c-4969-8bee-e870d761c3b6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:37.912963 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-95af8d8e-492c-4969-8bee-e870d761c3b6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:37.921044 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-95af8d8e-492c-4969-8bee-e870d761c3b6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.367844 Nov 15 12:40:37.937744 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 89/181] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:37 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:38.032098 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-bfe6ba9e-8dbc-40a2-a4e5-6f54c86da455 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:40:38.034038 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-bfe6ba9e-8dbc-40a2-a4e5-6f54c86da455 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:38.047398 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-66eb1ee7-58e7-48ad-ac75-02df7f49ef92 req-256bfd5e-4477-44af-a1a2-42adb6feee39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a107064a-524f-4964-97da-84d2b50d422d", "tag": "bb0f4a9a-c9a8-4d3c-b1a8-f21dae3f8b8a"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:40:38.049244 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:40:38.049244 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:40:38.058747 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bfe6ba9e-8dbc-40a2-a4e5-6f54c86da455 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:38.060302 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bfe6ba9e-8dbc-40a2-a4e5-6f54c86da455 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:38.061050 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bfe6ba9e-8dbc-40a2-a4e5-6f54c86da455 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:38.061487 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bfe6ba9e-8dbc-40a2-a4e5-6f54c86da455 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:38.066531 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-66eb1ee7-58e7-48ad-ac75-02df7f49ef92 req-256bfd5e-4477-44af-a1a2-42adb6feee39 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:38.067002 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-66eb1ee7-58e7-48ad-ac75-02df7f49ef92 req-256bfd5e-4477-44af-a1a2-42adb6feee39 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:38.088851 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-66eb1ee7-58e7-48ad-ac75-02df7f49ef92 req-256bfd5e-4477-44af-a1a2-42adb6feee39 service nova] Creating event network-changed:bb0f4a9a-c9a8-4d3c-b1a8-f21dae3f8b8a for instance a107064a-524f-4964-97da-84d2b50d422d on hv-cinder-68088 Nov 15 12:40:38.102921 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-66eb1ee7-58e7-48ad-ac75-02df7f49ef92 req-256bfd5e-4477-44af-a1a2-42adb6feee39 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059287 Nov 15 12:40:38.103900 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 90/182] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:40:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 15 12:40:38.387691 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-bfe6ba9e-8dbc-40a2-a4e5-6f54c86da455 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 14 microversion: 2.1 time: 0.359582 Nov 15 12:40:38.391501 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 93/183] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:40:38 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 14 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 15 12:40:38.946145 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-a6854b15-6e4c-413e-a2f2-c4d8a384d76f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:38.946881 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-a6854b15-6e4c-413e-a2f2-c4d8a384d76f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:38.954162 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a6854b15-6e4c-413e-a2f2-c4d8a384d76f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:38.954784 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a6854b15-6e4c-413e-a2f2-c4d8a384d76f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:38.955620 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a6854b15-6e4c-413e-a2f2-c4d8a384d76f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:38.956051 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a6854b15-6e4c-413e-a2f2-c4d8a384d76f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:39.210695 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-a6854b15-6e4c-413e-a2f2-c4d8a384d76f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:39.221160 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-a6854b15-6e4c-413e-a2f2-c4d8a384d76f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.280829 Nov 15 12:40:39.221744 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 91/184] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:38 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:39.399936 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-26cac95f-e538-4d12-9cd1-767664260fe2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:40:39.401101 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-26cac95f-e538-4d12-9cd1-767664260fe2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:39.409506 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-26cac95f-e538-4d12-9cd1-767664260fe2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:39.409953 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-26cac95f-e538-4d12-9cd1-767664260fe2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:39.410910 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-26cac95f-e538-4d12-9cd1-767664260fe2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:39.411670 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-26cac95f-e538-4d12-9cd1-767664260fe2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:39.511026 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-26cac95f-e538-4d12-9cd1-767664260fe2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 14 microversion: 2.1 time: 0.115071 Nov 15 12:40:39.511963 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 94/185] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:40:39 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 15 12:40:40.244045 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-c3a228e1-c1ee-4767-85ad-b86652c43aed tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:40.244045 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-c3a228e1-c1ee-4767-85ad-b86652c43aed tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:40.247192 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c3a228e1-c1ee-4767-85ad-b86652c43aed tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:40.247844 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c3a228e1-c1ee-4767-85ad-b86652c43aed tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:40.249251 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c3a228e1-c1ee-4767-85ad-b86652c43aed tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:40.250515 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c3a228e1-c1ee-4767-85ad-b86652c43aed tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:40.410032 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-c3a228e1-c1ee-4767-85ad-b86652c43aed tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:40.418281 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-c3a228e1-c1ee-4767-85ad-b86652c43aed tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.182498 Nov 15 12:40:40.422571 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 92/186] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:40 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:40.525077 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-7bf52fea-5302-45bd-a910-32028d10684f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:40:40.526254 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-7bf52fea-5302-45bd-a910-32028d10684f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:40.540781 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7bf52fea-5302-45bd-a910-32028d10684f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:40.542283 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7bf52fea-5302-45bd-a910-32028d10684f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:40.543736 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7bf52fea-5302-45bd-a910-32028d10684f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:40.545692 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7bf52fea-5302-45bd-a910-32028d10684f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:40.661932 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-7bf52fea-5302-45bd-a910-32028d10684f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 14 microversion: 2.1 time: 0.141748 Nov 15 12:40:40.662569 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 95/187] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:40:40 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 15 12:40:41.443067 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-bf7fb279-c7dc-44ff-963f-01406cbf1e7a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:41.444750 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-bf7fb279-c7dc-44ff-963f-01406cbf1e7a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:41.452186 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bf7fb279-c7dc-44ff-963f-01406cbf1e7a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:41.452896 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bf7fb279-c7dc-44ff-963f-01406cbf1e7a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:41.453669 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bf7fb279-c7dc-44ff-963f-01406cbf1e7a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:41.454110 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bf7fb279-c7dc-44ff-963f-01406cbf1e7a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:41.675679 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-90b80baa-969c-40b2-bed2-aec103fc7a18 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:40:41.678490 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-90b80baa-969c-40b2-bed2-aec103fc7a18 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:41.691783 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-90b80baa-969c-40b2-bed2-aec103fc7a18 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:41.693903 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-90b80baa-969c-40b2-bed2-aec103fc7a18 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:41.694993 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-90b80baa-969c-40b2-bed2-aec103fc7a18 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:41.697307 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-90b80baa-969c-40b2-bed2-aec103fc7a18 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:41.702186 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-bf7fb279-c7dc-44ff-963f-01406cbf1e7a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:41.720938 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-bf7fb279-c7dc-44ff-963f-01406cbf1e7a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.285070 Nov 15 12:40:41.730912 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 93/188] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:41 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:40:41.834500 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-90b80baa-969c-40b2-bed2-aec103fc7a18 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 14 microversion: 2.1 time: 0.160679 Nov 15 12:40:41.837883 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 96/189] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:40:41 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 15 12:40:42.742905 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-e5a3d7aa-2464-49e3-93cc-02b01ebc04ac tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:42.743766 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-e5a3d7aa-2464-49e3-93cc-02b01ebc04ac tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:42.756270 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e5a3d7aa-2464-49e3-93cc-02b01ebc04ac tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:42.757045 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e5a3d7aa-2464-49e3-93cc-02b01ebc04ac tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:42.758360 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e5a3d7aa-2464-49e3-93cc-02b01ebc04ac tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:42.759119 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e5a3d7aa-2464-49e3-93cc-02b01ebc04ac tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:42.849057 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-cd8acb88-6970-4932-8430-4670f4b9f001 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:40:42.850297 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-cd8acb88-6970-4932-8430-4670f4b9f001 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:42.860077 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cd8acb88-6970-4932-8430-4670f4b9f001 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:42.860502 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cd8acb88-6970-4932-8430-4670f4b9f001 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:42.861298 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cd8acb88-6970-4932-8430-4670f4b9f001 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:42.861728 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cd8acb88-6970-4932-8430-4670f4b9f001 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:43.035641 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-cd8acb88-6970-4932-8430-4670f4b9f001 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 14 microversion: 2.1 time: 0.192195 Nov 15 12:40:43.036138 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 97/190] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:40:42 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 14 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 15 12:40:43.040162 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-e5a3d7aa-2464-49e3-93cc-02b01ebc04ac tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:43.053031 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-e5a3d7aa-2464-49e3-93cc-02b01ebc04ac tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.313596 Nov 15 12:40:43.055081 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 94/191] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:42 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:44.048762 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e2d88960-950e-431b-886e-6fd1136d178c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:40:44.050182 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e2d88960-950e-431b-886e-6fd1136d178c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:44.057409 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e2d88960-950e-431b-886e-6fd1136d178c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:44.058142 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e2d88960-950e-431b-886e-6fd1136d178c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:44.059136 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e2d88960-950e-431b-886e-6fd1136d178c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:44.059572 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e2d88960-950e-431b-886e-6fd1136d178c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:44.075170 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-ea59f28d-00cd-4397-9a84-6d857c9b7463 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:44.076433 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-ea59f28d-00cd-4397-9a84-6d857c9b7463 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:44.092517 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ea59f28d-00cd-4397-9a84-6d857c9b7463 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:44.095365 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ea59f28d-00cd-4397-9a84-6d857c9b7463 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:44.096171 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ea59f28d-00cd-4397-9a84-6d857c9b7463 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:44.096738 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ea59f28d-00cd-4397-9a84-6d857c9b7463 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:44.210283 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e2d88960-950e-431b-886e-6fd1136d178c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 14 microversion: 2.1 time: 0.167267 Nov 15 12:40:44.211050 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 98/192] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:40:44 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 15 12:40:44.270551 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-ea59f28d-00cd-4397-9a84-6d857c9b7463 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:44.286442 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-ea59f28d-00cd-4397-9a84-6d857c9b7463 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.215398 Nov 15 12:40:44.295850 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 95/193] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:44 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:45.224044 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e0d16e57-bf8a-47c6-8c1e-588845c222ff tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:40:45.232212 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e0d16e57-bf8a-47c6-8c1e-588845c222ff tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:45.240633 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e0d16e57-bf8a-47c6-8c1e-588845c222ff tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:45.241644 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e0d16e57-bf8a-47c6-8c1e-588845c222ff tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:45.242757 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e0d16e57-bf8a-47c6-8c1e-588845c222ff tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:45.243438 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e0d16e57-bf8a-47c6-8c1e-588845c222ff tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:45.300477 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-4cac9e72-67fe-4f6b-836f-697aba7f6ce3 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:45.301274 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-4cac9e72-67fe-4f6b-836f-697aba7f6ce3 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:45.308476 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4cac9e72-67fe-4f6b-836f-697aba7f6ce3 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:45.308998 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4cac9e72-67fe-4f6b-836f-697aba7f6ce3 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:45.309920 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4cac9e72-67fe-4f6b-836f-697aba7f6ce3 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:45.310350 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4cac9e72-67fe-4f6b-836f-697aba7f6ce3 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:45.337080 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-4cac9e72-67fe-4f6b-836f-697aba7f6ce3 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Going to try to terminate instance {{(pid=122568) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 15 12:40:45.394000 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e0d16e57-bf8a-47c6-8c1e-588845c222ff tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 14 microversion: 2.1 time: 0.174130 Nov 15 12:40:45.395266 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 99/194] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:40:45 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 14 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 15 12:40:45.404791 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-6862ad18-e110-4b4a-a2d0-bd9001ae905d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:45.406162 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-6862ad18-e110-4b4a-a2d0-bd9001ae905d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:45.416505 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6862ad18-e110-4b4a-a2d0-bd9001ae905d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:45.417475 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6862ad18-e110-4b4a-a2d0-bd9001ae905d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:45.419317 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6862ad18-e110-4b4a-a2d0-bd9001ae905d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:45.420395 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6862ad18-e110-4b4a-a2d0-bd9001ae905d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:45.438440 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-4cac9e72-67fe-4f6b-836f-697aba7f6ce3 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "DELETE /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 204 len: 0 microversion: 2.1 time: 0.141562 Nov 15 12:40:45.442857 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 96/195] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Nov 15 12:40:45 2021] DELETE /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 15 12:40:45.450792 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-fdb600aa-f3ec-4294-b955-de3d4e6233e6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:45.451586 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-fdb600aa-f3ec-4294-b955-de3d4e6233e6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:45.458150 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fdb600aa-f3ec-4294-b955-de3d4e6233e6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:45.458602 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fdb600aa-f3ec-4294-b955-de3d4e6233e6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:45.459423 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fdb600aa-f3ec-4294-b955-de3d4e6233e6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:45.459851 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fdb600aa-f3ec-4294-b955-de3d4e6233e6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:45.627554 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-6862ad18-e110-4b4a-a2d0-bd9001ae905d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:45.634995 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-6862ad18-e110-4b4a-a2d0-bd9001ae905d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.238280 Nov 15 12:40:45.635563 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 100/196] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:45 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:45.649095 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-fdb600aa-f3ec-4294-b955-de3d4e6233e6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:45.657755 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-fdb600aa-f3ec-4294-b955-de3d4e6233e6 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1554 microversion: 2.1 time: 0.212563 Nov 15 12:40:45.658338 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 97/197] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:45 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1554 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:46.406886 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-6e2e49cb-ed01-4623-934f-0d1811ba4b90 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:40:46.407960 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-6e2e49cb-ed01-4623-934f-0d1811ba4b90 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:46.414225 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6e2e49cb-ed01-4623-934f-0d1811ba4b90 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:46.414850 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6e2e49cb-ed01-4623-934f-0d1811ba4b90 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:46.415632 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6e2e49cb-ed01-4623-934f-0d1811ba4b90 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:46.416055 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6e2e49cb-ed01-4623-934f-0d1811ba4b90 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:46.521790 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-6e2e49cb-ed01-4623-934f-0d1811ba4b90 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 14 microversion: 2.1 time: 0.119685 Nov 15 12:40:46.522421 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 101/198] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:40:46 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 15 12:40:46.652197 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-c8136ab0-68bb-4e06-99ce-50901330af1b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:46.653390 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-c8136ab0-68bb-4e06-99ce-50901330af1b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:46.660601 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c8136ab0-68bb-4e06-99ce-50901330af1b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:46.661049 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c8136ab0-68bb-4e06-99ce-50901330af1b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:46.661831 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c8136ab0-68bb-4e06-99ce-50901330af1b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:46.662444 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c8136ab0-68bb-4e06-99ce-50901330af1b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:46.676308 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-b3024052-0cf7-42be-b6d4-7831680f7686 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:46.677274 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-b3024052-0cf7-42be-b6d4-7831680f7686 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:46.686832 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b3024052-0cf7-42be-b6d4-7831680f7686 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:46.687567 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b3024052-0cf7-42be-b6d4-7831680f7686 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:46.688485 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b3024052-0cf7-42be-b6d4-7831680f7686 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:46.688914 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b3024052-0cf7-42be-b6d4-7831680f7686 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:46.869369 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-c8136ab0-68bb-4e06-99ce-50901330af1b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:46.874327 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-b3024052-0cf7-42be-b6d4-7831680f7686 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:46.878191 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-c8136ab0-68bb-4e06-99ce-50901330af1b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.229749 Nov 15 12:40:46.879011 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 98/199] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:46 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:46.882833 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-b3024052-0cf7-42be-b6d4-7831680f7686 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1554 microversion: 2.1 time: 0.211266 Nov 15 12:40:46.883421 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 102/200] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:46 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1554 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:40:47.533309 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-7d9baa4a-3578-4b87-9c5a-0ae8a5155561 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:40:47.534208 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-7d9baa4a-3578-4b87-9c5a-0ae8a5155561 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:47.540095 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7d9baa4a-3578-4b87-9c5a-0ae8a5155561 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:47.540533 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7d9baa4a-3578-4b87-9c5a-0ae8a5155561 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:47.541291 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7d9baa4a-3578-4b87-9c5a-0ae8a5155561 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:47.541716 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7d9baa4a-3578-4b87-9c5a-0ae8a5155561 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:47.896437 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-0f04fb21-3ffe-471b-89dc-4216412b415a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:47.897094 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-0f04fb21-3ffe-471b-89dc-4216412b415a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:47.903496 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0f04fb21-3ffe-471b-89dc-4216412b415a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:47.903935 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0f04fb21-3ffe-471b-89dc-4216412b415a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:47.904700 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0f04fb21-3ffe-471b-89dc-4216412b415a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:47.905125 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0f04fb21-3ffe-471b-89dc-4216412b415a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:48.038111 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-0f04fb21-3ffe-471b-89dc-4216412b415a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:48.045361 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-0f04fb21-3ffe-471b-89dc-4216412b415a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.152973 Nov 15 12:40:48.045928 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 103/201] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:47 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:48.050976 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-4bded1ea-e7de-4af5-b343-5ef0806b3677 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:48.051563 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-4bded1ea-e7de-4af5-b343-5ef0806b3677 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:48.057053 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4bded1ea-e7de-4af5-b343-5ef0806b3677 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:48.057490 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4bded1ea-e7de-4af5-b343-5ef0806b3677 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:48.058256 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4bded1ea-e7de-4af5-b343-5ef0806b3677 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:48.058680 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4bded1ea-e7de-4af5-b343-5ef0806b3677 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:48.194712 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-4bded1ea-e7de-4af5-b343-5ef0806b3677 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:48.202956 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-4bded1ea-e7de-4af5-b343-5ef0806b3677 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1554 microversion: 2.1 time: 0.155264 Nov 15 12:40:48.204457 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 104/202] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:48 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:49.063282 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-53c0990b-9790-4223-a8db-dac4558b7545 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:49.064074 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-53c0990b-9790-4223-a8db-dac4558b7545 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:49.071246 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-53c0990b-9790-4223-a8db-dac4558b7545 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:49.071792 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-53c0990b-9790-4223-a8db-dac4558b7545 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:49.072688 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-53c0990b-9790-4223-a8db-dac4558b7545 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:49.073144 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-53c0990b-9790-4223-a8db-dac4558b7545 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:49.216320 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-53c0990b-9790-4223-a8db-dac4558b7545 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:49.224485 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-53c0990b-9790-4223-a8db-dac4558b7545 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.164988 Nov 15 12:40:49.225058 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 105/203] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:49 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:49.229341 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-47c9ce16-abc4-42f6-9d22-379d67df0ed1 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:49.229928 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-47c9ce16-abc4-42f6-9d22-379d67df0ed1 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:49.236852 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-47c9ce16-abc4-42f6-9d22-379d67df0ed1 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:49.237295 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-47c9ce16-abc4-42f6-9d22-379d67df0ed1 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:49.238105 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-47c9ce16-abc4-42f6-9d22-379d67df0ed1 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:49.238540 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-47c9ce16-abc4-42f6-9d22-379d67df0ed1 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:49.375883 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-47c9ce16-abc4-42f6-9d22-379d67df0ed1 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:49.383675 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-47c9ce16-abc4-42f6-9d22-379d67df0ed1 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1554 microversion: 2.1 time: 0.157686 Nov 15 12:40:49.384250 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 106/204] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:49 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:49.760763 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-7d9baa4a-3578-4b87-9c5a-0ae8a5155561 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 14 microversion: 2.1 time: 2.232013 Nov 15 12:40:49.761427 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 99/205] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:40:47 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 14 bytes in 2234 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 15 12:40:50.242230 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-7e7dfa48-1772-4f4e-a0ed-b68948bd9925 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:50.242882 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-7e7dfa48-1772-4f4e-a0ed-b68948bd9925 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:50.249009 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7e7dfa48-1772-4f4e-a0ed-b68948bd9925 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:50.249578 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7e7dfa48-1772-4f4e-a0ed-b68948bd9925 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:50.250636 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7e7dfa48-1772-4f4e-a0ed-b68948bd9925 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:50.251093 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7e7dfa48-1772-4f4e-a0ed-b68948bd9925 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:50.401482 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-eb048f63-6206-46b6-843b-d8949a3bb856 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:50.402184 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-eb048f63-6206-46b6-843b-d8949a3bb856 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:50.410946 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-eb048f63-6206-46b6-843b-d8949a3bb856 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:50.411701 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-eb048f63-6206-46b6-843b-d8949a3bb856 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:50.412455 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-eb048f63-6206-46b6-843b-d8949a3bb856 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:50.412892 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-eb048f63-6206-46b6-843b-d8949a3bb856 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:50.415249 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-7e7dfa48-1772-4f4e-a0ed-b68948bd9925 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:50.422691 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-7e7dfa48-1772-4f4e-a0ed-b68948bd9925 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.184005 Nov 15 12:40:50.423473 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 107/206] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:50 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:50.566287 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-eb048f63-6206-46b6-843b-d8949a3bb856 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:50.574344 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-eb048f63-6206-46b6-843b-d8949a3bb856 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1554 microversion: 2.1 time: 0.176810 Nov 15 12:40:50.575075 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 100/207] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:50 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:50.772631 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-6fa70f65-1a32-484e-a64f-2a14dfba669b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:40:50.773571 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-6fa70f65-1a32-484e-a64f-2a14dfba669b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:50.779683 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6fa70f65-1a32-484e-a64f-2a14dfba669b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:50.780131 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6fa70f65-1a32-484e-a64f-2a14dfba669b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:50.781460 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6fa70f65-1a32-484e-a64f-2a14dfba669b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:50.781893 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6fa70f65-1a32-484e-a64f-2a14dfba669b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:50.872732 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-6fa70f65-1a32-484e-a64f-2a14dfba669b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 14 microversion: 2.1 time: 0.103915 Nov 15 12:40:50.873761 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 108/208] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:40:50 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 15 12:40:51.185756 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-4d3564de-6b71-443d-89f9-d09938fa903e req-3d3f2057-278f-47eb-aae9-188235c0eda0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10b7dd7b-ae59-4375-b46b-47dacaf4be62", "name": "network-vif-deleted", "tag": "6b8d7663-6fa5-48c7-b3b3-f2a4a7d6782e"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:40:51.187666 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:40:51.187666 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:40:51.194505 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-4d3564de-6b71-443d-89f9-d09938fa903e req-3d3f2057-278f-47eb-aae9-188235c0eda0 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:51.194962 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-4d3564de-6b71-443d-89f9-d09938fa903e req-3d3f2057-278f-47eb-aae9-188235c0eda0 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:51.207142 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-4d3564de-6b71-443d-89f9-d09938fa903e req-3d3f2057-278f-47eb-aae9-188235c0eda0 service nova] Creating event network-vif-deleted:6b8d7663-6fa5-48c7-b3b3-f2a4a7d6782e for instance 10b7dd7b-ae59-4375-b46b-47dacaf4be62 on hv-cinder-68088 Nov 15 12:40:51.216238 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-4d3564de-6b71-443d-89f9-d09938fa903e req-3d3f2057-278f-47eb-aae9-188235c0eda0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034298 Nov 15 12:40:51.217011 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 101/209] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:40:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:40:51.440278 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-51959263-e065-43bc-ad52-9efad70cab82 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:51.440955 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-51959263-e065-43bc-ad52-9efad70cab82 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:51.448372 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-51959263-e065-43bc-ad52-9efad70cab82 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:51.448882 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-51959263-e065-43bc-ad52-9efad70cab82 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:51.449932 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-51959263-e065-43bc-ad52-9efad70cab82 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:51.450362 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-51959263-e065-43bc-ad52-9efad70cab82 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:51.589266 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-51959263-e065-43bc-ad52-9efad70cab82 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:51.592414 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-b061cf8e-8cad-49f9-9bda-2a29aa468209 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:51.594531 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-b061cf8e-8cad-49f9-9bda-2a29aa468209 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:51.597931 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-51959263-e065-43bc-ad52-9efad70cab82 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.161540 Nov 15 12:40:51.598730 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 109/210] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:51 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:51.600594 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b061cf8e-8cad-49f9-9bda-2a29aa468209 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:51.601038 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b061cf8e-8cad-49f9-9bda-2a29aa468209 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:51.601816 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b061cf8e-8cad-49f9-9bda-2a29aa468209 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:51.602244 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b061cf8e-8cad-49f9-9bda-2a29aa468209 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:51.672225 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-b061cf8e-8cad-49f9-9bda-2a29aa468209 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:51.680955 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-b061cf8e-8cad-49f9-9bda-2a29aa468209 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1346 microversion: 2.1 time: 0.092911 Nov 15 12:40:51.681530 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 102/211] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:51 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1346 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:51.893347 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-125cb8a7-d586-46bc-91dc-7b256f4f6c32 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:40:51.894283 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-125cb8a7-d586-46bc-91dc-7b256f4f6c32 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:51.900206 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-125cb8a7-d586-46bc-91dc-7b256f4f6c32 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:51.900644 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-125cb8a7-d586-46bc-91dc-7b256f4f6c32 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:51.901418 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-125cb8a7-d586-46bc-91dc-7b256f4f6c32 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:51.901851 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-125cb8a7-d586-46bc-91dc-7b256f4f6c32 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:52.615522 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-0d856b7d-0ad8-4275-9fe5-95346280ed72 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:52.616163 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-0d856b7d-0ad8-4275-9fe5-95346280ed72 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:52.622348 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0d856b7d-0ad8-4275-9fe5-95346280ed72 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:52.622806 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0d856b7d-0ad8-4275-9fe5-95346280ed72 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:52.623571 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0d856b7d-0ad8-4275-9fe5-95346280ed72 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:52.623986 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0d856b7d-0ad8-4275-9fe5-95346280ed72 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:52.756701 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-0d856b7d-0ad8-4275-9fe5-95346280ed72 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:52.764525 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-0d856b7d-0ad8-4275-9fe5-95346280ed72 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.152625 Nov 15 12:40:52.765099 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 103/212] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:52 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:40:52.769267 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-8ba5539f-65cd-4251-a5ef-0ec8c666c6eb tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:52.769850 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-8ba5539f-65cd-4251-a5ef-0ec8c666c6eb tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:52.775464 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8ba5539f-65cd-4251-a5ef-0ec8c666c6eb tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:52.775897 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8ba5539f-65cd-4251-a5ef-0ec8c666c6eb tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:52.776674 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8ba5539f-65cd-4251-a5ef-0ec8c666c6eb tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:52.777091 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8ba5539f-65cd-4251-a5ef-0ec8c666c6eb tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:52.835422 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-8ba5539f-65cd-4251-a5ef-0ec8c666c6eb tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:52.843155 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-8ba5539f-65cd-4251-a5ef-0ec8c666c6eb tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1346 microversion: 2.1 time: 0.077097 Nov 15 12:40:52.843715 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 104/213] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:52 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1346 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:53.782267 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-ccada1d4-e863-4f97-ad40-537ca1d4a7b4 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:53.783037 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-ccada1d4-e863-4f97-ad40-537ca1d4a7b4 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:53.789164 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ccada1d4-e863-4f97-ad40-537ca1d4a7b4 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:53.789600 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ccada1d4-e863-4f97-ad40-537ca1d4a7b4 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:53.790366 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ccada1d4-e863-4f97-ad40-537ca1d4a7b4 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:53.790913 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ccada1d4-e863-4f97-ad40-537ca1d4a7b4 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:53.921354 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-ccada1d4-e863-4f97-ad40-537ca1d4a7b4 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:53.928887 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-ccada1d4-e863-4f97-ad40-537ca1d4a7b4 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.151129 Nov 15 12:40:53.929454 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 105/214] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:53 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:40:53.933700 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-302a44bc-a77b-4d7d-af1d-a4c2437a56c7 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:53.935003 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-302a44bc-a77b-4d7d-af1d-a4c2437a56c7 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:53.941526 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-302a44bc-a77b-4d7d-af1d-a4c2437a56c7 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:53.942002 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-302a44bc-a77b-4d7d-af1d-a4c2437a56c7 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:53.942851 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-302a44bc-a77b-4d7d-af1d-a4c2437a56c7 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:53.943183 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-302a44bc-a77b-4d7d-af1d-a4c2437a56c7 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:54.004610 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-302a44bc-a77b-4d7d-af1d-a4c2437a56c7 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:54.012219 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-302a44bc-a77b-4d7d-af1d-a4c2437a56c7 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1346 microversion: 2.1 time: 0.081844 Nov 15 12:40:54.012776 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 106/215] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:53 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1346 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:54.174013 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-125cb8a7-d586-46bc-91dc-7b256f4f6c32 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 15025 microversion: 2.1 time: 2.292968 Nov 15 12:40:54.174940 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 110/216] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:40:51 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 15025 bytes in 2295 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:40:54.946893 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-3c7d7900-f14d-446c-a9bb-f2bfd33d5e7b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:54.947666 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-3c7d7900-f14d-446c-a9bb-f2bfd33d5e7b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:54.954764 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3c7d7900-f14d-446c-a9bb-f2bfd33d5e7b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:54.955391 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3c7d7900-f14d-446c-a9bb-f2bfd33d5e7b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:54.956436 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3c7d7900-f14d-446c-a9bb-f2bfd33d5e7b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:54.956848 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3c7d7900-f14d-446c-a9bb-f2bfd33d5e7b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:55.029664 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-96e972b9-4c09-4427-aeda-0349af08374b tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:55.030487 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-96e972b9-4c09-4427-aeda-0349af08374b tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:55.037815 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-96e972b9-4c09-4427-aeda-0349af08374b tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:55.038474 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-96e972b9-4c09-4427-aeda-0349af08374b tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:55.039359 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-96e972b9-4c09-4427-aeda-0349af08374b tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:55.039788 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-96e972b9-4c09-4427-aeda-0349af08374b tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:55.078827 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-96e972b9-4c09-4427-aeda-0349af08374b tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:55.079824 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-96e972b9-4c09-4427-aeda-0349af08374b tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:55.080140 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.objects.instance [None req-96e972b9-4c09-4427-aeda-0349af08374b tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lazy-loading 'fault' on Instance uuid 10b7dd7b-ae59-4375-b46b-47dacaf4be62 {{(pid=122567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 15 12:40:55.119056 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-3c7d7900-f14d-446c-a9bb-f2bfd33d5e7b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:55.138625 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-96e972b9-4c09-4427-aeda-0349af08374b tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbc2c70765e4a2b8ac3974676ed1eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c643bbc1074232958965e5aceb5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:55.140184 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-3c7d7900-f14d-446c-a9bb-f2bfd33d5e7b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.197755 Nov 15 12:40:55.140769 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 107/217] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:54 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:55.150203 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-96e972b9-4c09-4427-aeda-0349af08374b tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 200 len: 1351 microversion: 2.1 time: 0.123460 Nov 15 12:40:55.150203 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 111/218] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:55 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 1351 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:40:55.189427 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-8c4a218a-ca2c-4b65-a36d-d1b6bd5473f3 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:40:55.189427 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-8c4a218a-ca2c-4b65-a36d-d1b6bd5473f3 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:55.194612 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8c4a218a-ca2c-4b65-a36d-d1b6bd5473f3 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:55.195089 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8c4a218a-ca2c-4b65-a36d-d1b6bd5473f3 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:55.196105 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8c4a218a-ca2c-4b65-a36d-d1b6bd5473f3 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:55.196683 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8c4a218a-ca2c-4b65-a36d-d1b6bd5473f3 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:55.320630 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-8c4a218a-ca2c-4b65-a36d-d1b6bd5473f3 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 17861 microversion: 2.1 time: 0.138259 Nov 15 12:40:55.325544 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 112/219] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:40:55 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 17861 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:40:56.157442 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-c6e83863-dfe8-445a-81be-c2c9e4102d09 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:56.158040 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-c6e83863-dfe8-445a-81be-c2c9e4102d09 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:56.164776 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c6e83863-dfe8-445a-81be-c2c9e4102d09 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:56.165222 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c6e83863-dfe8-445a-81be-c2c9e4102d09 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:56.166009 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c6e83863-dfe8-445a-81be-c2c9e4102d09 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:56.166436 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c6e83863-dfe8-445a-81be-c2c9e4102d09 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:56.167288 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-bde8eb93-bd82-4334-907e-42ecbb144dc8 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:56.168015 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-bde8eb93-bd82-4334-907e-42ecbb144dc8 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:56.176213 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bde8eb93-bd82-4334-907e-42ecbb144dc8 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:56.176664 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bde8eb93-bd82-4334-907e-42ecbb144dc8 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:56.177891 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bde8eb93-bd82-4334-907e-42ecbb144dc8 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:56.177891 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bde8eb93-bd82-4334-907e-42ecbb144dc8 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:56.193457 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.wsgi [None req-bde8eb93-bd82-4334-907e-42ecbb144dc8 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] HTTP exception thrown: Instance 10b7dd7b-ae59-4375-b46b-47dacaf4be62 could not be found. Nov 15 12:40:56.194691 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-bde8eb93-bd82-4334-907e-42ecbb144dc8 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Returning 404 to user: Instance 10b7dd7b-ae59-4375-b46b-47dacaf4be62 could not be found. {{(pid=122567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:40:56.200488 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-bde8eb93-bd82-4334-907e-42ecbb144dc8 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 404 len: 111 microversion: 2.1 time: 0.031899 Nov 15 12:40:56.200488 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 113/220] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:56 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 15 12:40:56.298956 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-3f1f2b39-6896-425a-9fae-4d7a01c74fd7 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:56.300135 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-3f1f2b39-6896-425a-9fae-4d7a01c74fd7 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:56.306463 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3f1f2b39-6896-425a-9fae-4d7a01c74fd7 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:56.306948 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3f1f2b39-6896-425a-9fae-4d7a01c74fd7 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:56.307717 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3f1f2b39-6896-425a-9fae-4d7a01c74fd7 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:56.308137 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3f1f2b39-6896-425a-9fae-4d7a01c74fd7 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:56.311892 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-c6e83863-dfe8-445a-81be-c2c9e4102d09 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:56.320398 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-c6e83863-dfe8-445a-81be-c2c9e4102d09 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.167035 Nov 15 12:40:56.322263 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.wsgi [None req-3f1f2b39-6896-425a-9fae-4d7a01c74fd7 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] HTTP exception thrown: Instance 10b7dd7b-ae59-4375-b46b-47dacaf4be62 could not be found. Nov 15 12:40:56.322953 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-3f1f2b39-6896-425a-9fae-4d7a01c74fd7 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Returning 404 to user: Instance 10b7dd7b-ae59-4375-b46b-47dacaf4be62 could not be found. {{(pid=122567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:40:56.323982 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-3f1f2b39-6896-425a-9fae-4d7a01c74fd7 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.029493 Nov 15 12:40:56.324842 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 114/221] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Nov 15 12:40:56 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62/os-volume_attachments => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 15 12:40:56.332879 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-97fdab47-7035-42a8-8570-5ccea1b1f35b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:40:56.333072 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 108/222] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:56 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:56.333956 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-97fdab47-7035-42a8-8570-5ccea1b1f35b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:56.340251 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-97fdab47-7035-42a8-8570-5ccea1b1f35b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:56.340763 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-97fdab47-7035-42a8-8570-5ccea1b1f35b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:56.341623 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-97fdab47-7035-42a8-8570-5ccea1b1f35b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:56.342114 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-97fdab47-7035-42a8-8570-5ccea1b1f35b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:57.342271 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-aea3480e-9302-4eef-95e6-bcd91578a0ab tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:57.342961 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-aea3480e-9302-4eef-95e6-bcd91578a0ab tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:57.349507 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-aea3480e-9302-4eef-95e6-bcd91578a0ab tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:57.349952 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-aea3480e-9302-4eef-95e6-bcd91578a0ab tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:57.350735 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-aea3480e-9302-4eef-95e6-bcd91578a0ab tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:57.351189 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-aea3480e-9302-4eef-95e6-bcd91578a0ab tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:57.482925 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-aea3480e-9302-4eef-95e6-bcd91578a0ab tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:57.490337 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-aea3480e-9302-4eef-95e6-bcd91578a0ab tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.156759 Nov 15 12:40:57.490936 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 109/223] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:57 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:58.501991 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-97fdab47-7035-42a8-8570-5ccea1b1f35b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 20973 microversion: 2.1 time: 2.172285 Nov 15 12:40:58.502521 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 115/224] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:40:56 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 20973 bytes in 2174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:40:58.508475 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-31d45579-be51-4b5a-82de-125d0486fbce tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:58.509102 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-31d45579-be51-4b5a-82de-125d0486fbce tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:58.515716 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-31d45579-be51-4b5a-82de-125d0486fbce tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:58.516153 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-31d45579-be51-4b5a-82de-125d0486fbce tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:58.516915 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-31d45579-be51-4b5a-82de-125d0486fbce tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:58.517336 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-31d45579-be51-4b5a-82de-125d0486fbce tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:58.847936 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-31d45579-be51-4b5a-82de-125d0486fbce tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:40:58.855725 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-31d45579-be51-4b5a-82de-125d0486fbce tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.351030 Nov 15 12:40:58.856297 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 110/225] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:58 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:40:59.515217 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-70dafc2d-252a-4eb0-9d75-53001f4a8623 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:40:59.516044 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-70dafc2d-252a-4eb0-9d75-53001f4a8623 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:59.523900 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-70dafc2d-252a-4eb0-9d75-53001f4a8623 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:59.524335 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-70dafc2d-252a-4eb0-9d75-53001f4a8623 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:59.525096 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-70dafc2d-252a-4eb0-9d75-53001f4a8623 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:59.525518 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-70dafc2d-252a-4eb0-9d75-53001f4a8623 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:59.648929 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-b724aa6c-845b-4686-9a32-28e464c8d749 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:59.649500 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-70dafc2d-252a-4eb0-9d75-53001f4a8623 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 22304 microversion: 2.1 time: 0.139024 Nov 15 12:40:59.649594 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-b724aa6c-845b-4686-9a32-28e464c8d749 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:59.649699 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 116/226] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:40:59 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 22304 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:40:59.656633 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b724aa6c-845b-4686-9a32-28e464c8d749 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:59.657036 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b724aa6c-845b-4686-9a32-28e464c8d749 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:59.657935 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b724aa6c-845b-4686-9a32-28e464c8d749 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:59.658935 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b724aa6c-845b-4686-9a32-28e464c8d749 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:59.673800 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.wsgi [None req-b724aa6c-845b-4686-9a32-28e464c8d749 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] HTTP exception thrown: Instance 10b7dd7b-ae59-4375-b46b-47dacaf4be62 could not be found. Nov 15 12:40:59.674645 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-b724aa6c-845b-4686-9a32-28e464c8d749 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Returning 404 to user: Instance 10b7dd7b-ae59-4375-b46b-47dacaf4be62 could not be found. {{(pid=122568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:40:59.675487 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-b724aa6c-845b-4686-9a32-28e464c8d749 tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "DELETE /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 404 len: 111 microversion: 2.1 time: 0.030466 Nov 15 12:40:59.676030 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 111/227] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Nov 15 12:40:59 2021] DELETE /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 15 12:40:59.685756 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-a16825ec-5604-4c7d-a50a-b6fff6b4d8cd tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:59.686880 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-a16825ec-5604-4c7d-a50a-b6fff6b4d8cd tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] [instance: 10b7dd7b-ae59-4375-b46b-47dacaf4be62] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:59.695325 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a16825ec-5604-4c7d-a50a-b6fff6b4d8cd tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:59.696136 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a16825ec-5604-4c7d-a50a-b6fff6b4d8cd tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:59.697387 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a16825ec-5604-4c7d-a50a-b6fff6b4d8cd tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:59.698038 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a16825ec-5604-4c7d-a50a-b6fff6b4d8cd tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:59.713654 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.wsgi [None req-a16825ec-5604-4c7d-a50a-b6fff6b4d8cd tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] HTTP exception thrown: Instance 10b7dd7b-ae59-4375-b46b-47dacaf4be62 could not be found. Nov 15 12:40:59.714308 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-a16825ec-5604-4c7d-a50a-b6fff6b4d8cd tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] Returning 404 to user: Instance 10b7dd7b-ae59-4375-b46b-47dacaf4be62 could not be found. {{(pid=122567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:40:59.715240 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-a16825ec-5604-4c7d-a50a-b6fff6b4d8cd tempest-DeleteServersTestJSON-707051754 tempest-DeleteServersTestJSON-707051754-project] 10.222.0.43 "GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62" status: 404 len: 111 microversion: 2.1 time: 0.034795 Nov 15 12:40:59.715866 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 117/228] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:59 2021] GET /compute/v2.1/servers/10b7dd7b-ae59-4375-b46b-47dacaf4be62 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 15 12:40:59.874533 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-99d0c78d-ab40-4570-9752-7ebb87c289c2 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:40:59.875774 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-99d0c78d-ab40-4570-9752-7ebb87c289c2 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:40:59.882444 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-99d0c78d-ab40-4570-9752-7ebb87c289c2 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:59.883279 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-99d0c78d-ab40-4570-9752-7ebb87c289c2 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:40:59.884394 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-99d0c78d-ab40-4570-9752-7ebb87c289c2 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:40:59.885030 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-99d0c78d-ab40-4570-9752-7ebb87c289c2 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:00.145201 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-99d0c78d-ab40-4570-9752-7ebb87c289c2 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:00.159208 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-99d0c78d-ab40-4570-9752-7ebb87c289c2 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.289719 Nov 15 12:41:00.164709 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 112/229] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:40:59 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:00.661131 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-d9d55ae8-f211-4830-a2ef-65cec1fd1e4a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:00.662888 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-d9d55ae8-f211-4830-a2ef-65cec1fd1e4a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:00.669932 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d9d55ae8-f211-4830-a2ef-65cec1fd1e4a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:00.670559 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d9d55ae8-f211-4830-a2ef-65cec1fd1e4a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:00.672668 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d9d55ae8-f211-4830-a2ef-65cec1fd1e4a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:00.673248 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d9d55ae8-f211-4830-a2ef-65cec1fd1e4a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:00.779119 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-d9d55ae8-f211-4830-a2ef-65cec1fd1e4a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 23209 microversion: 2.1 time: 0.121493 Nov 15 12:41:00.783797 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 118/230] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:41:00 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 23209 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:41:01.176945 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-6c07cee3-4d56-4395-a927-a65b7cc63603 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:01.177620 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-6c07cee3-4d56-4395-a927-a65b7cc63603 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:01.184465 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6c07cee3-4d56-4395-a927-a65b7cc63603 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:01.184914 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6c07cee3-4d56-4395-a927-a65b7cc63603 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:01.186069 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6c07cee3-4d56-4395-a927-a65b7cc63603 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:01.186541 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6c07cee3-4d56-4395-a927-a65b7cc63603 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:01.397821 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-6c07cee3-4d56-4395-a927-a65b7cc63603 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:01.406137 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-6c07cee3-4d56-4395-a927-a65b7cc63603 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.232662 Nov 15 12:41:01.406717 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 113/231] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:01 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:01.791621 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-07ba8242-25fa-4a10-af7a-cd3f61dd4b2a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:01.792636 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-07ba8242-25fa-4a10-af7a-cd3f61dd4b2a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:01.806097 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-07ba8242-25fa-4a10-af7a-cd3f61dd4b2a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:01.807478 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-07ba8242-25fa-4a10-af7a-cd3f61dd4b2a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:01.808308 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-07ba8242-25fa-4a10-af7a-cd3f61dd4b2a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:01.808749 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-07ba8242-25fa-4a10-af7a-cd3f61dd4b2a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:01.919549 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-07ba8242-25fa-4a10-af7a-cd3f61dd4b2a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 24263 microversion: 2.1 time: 0.131156 Nov 15 12:41:01.920185 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 119/232] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:41:01 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 24263 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:41:02.426409 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-65c7b75a-4ea9-4d9a-add9-cb3213453d3d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:02.428344 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-65c7b75a-4ea9-4d9a-add9-cb3213453d3d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:02.440385 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-65c7b75a-4ea9-4d9a-add9-cb3213453d3d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:02.441350 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-65c7b75a-4ea9-4d9a-add9-cb3213453d3d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:02.442550 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-65c7b75a-4ea9-4d9a-add9-cb3213453d3d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:02.443217 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-65c7b75a-4ea9-4d9a-add9-cb3213453d3d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:02.774433 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-65c7b75a-4ea9-4d9a-add9-cb3213453d3d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:02.789105 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-65c7b75a-4ea9-4d9a-add9-cb3213453d3d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.365456 Nov 15 12:41:02.790433 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 114/233] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:02 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:02.934270 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e9142f2b-92ef-4811-8e4a-0ddd1e48fef4 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:02.935344 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e9142f2b-92ef-4811-8e4a-0ddd1e48fef4 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:02.942347 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e9142f2b-92ef-4811-8e4a-0ddd1e48fef4 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:02.943019 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e9142f2b-92ef-4811-8e4a-0ddd1e48fef4 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:02.944060 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e9142f2b-92ef-4811-8e4a-0ddd1e48fef4 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:02.944648 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e9142f2b-92ef-4811-8e4a-0ddd1e48fef4 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:03.086098 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e9142f2b-92ef-4811-8e4a-0ddd1e48fef4 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 25154 microversion: 2.1 time: 0.157337 Nov 15 12:41:03.087406 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 120/234] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:41:02 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 25154 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:41:03.809616 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-7cfd3911-c737-4101-b472-d825806e7287 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:03.811262 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-7cfd3911-c737-4101-b472-d825806e7287 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:03.819978 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7cfd3911-c737-4101-b472-d825806e7287 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:03.820609 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7cfd3911-c737-4101-b472-d825806e7287 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:03.821535 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7cfd3911-c737-4101-b472-d825806e7287 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:03.822200 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7cfd3911-c737-4101-b472-d825806e7287 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:04.101798 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-b11106c9-4af0-4bd8-a28d-84d82cb4e7de tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:04.107316 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-b11106c9-4af0-4bd8-a28d-84d82cb4e7de tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:04.121320 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b11106c9-4af0-4bd8-a28d-84d82cb4e7de tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:04.122084 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b11106c9-4af0-4bd8-a28d-84d82cb4e7de tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:04.123080 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b11106c9-4af0-4bd8-a28d-84d82cb4e7de tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:04.125155 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b11106c9-4af0-4bd8-a28d-84d82cb4e7de tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:04.169959 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-7cfd3911-c737-4101-b472-d825806e7287 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:04.182073 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-7cfd3911-c737-4101-b472-d825806e7287 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.377561 Nov 15 12:41:04.193704 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 115/235] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:03 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:04.252677 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-b11106c9-4af0-4bd8-a28d-84d82cb4e7de tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 26181 microversion: 2.1 time: 0.154138 Nov 15 12:41:04.256488 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 121/236] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:41:04 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 26181 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:41:05.220985 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-aa7db9fa-4a79-44ea-b4f2-c447fce5a06a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:05.221743 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-aa7db9fa-4a79-44ea-b4f2-c447fce5a06a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:05.238979 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-aa7db9fa-4a79-44ea-b4f2-c447fce5a06a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:05.242742 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-aa7db9fa-4a79-44ea-b4f2-c447fce5a06a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:05.243866 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-aa7db9fa-4a79-44ea-b4f2-c447fce5a06a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:05.246373 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-aa7db9fa-4a79-44ea-b4f2-c447fce5a06a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:05.270594 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-80e2e1bf-17b7-44cd-969a-1125775ba312 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:05.272066 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-80e2e1bf-17b7-44cd-969a-1125775ba312 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:05.282298 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-80e2e1bf-17b7-44cd-969a-1125775ba312 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:05.283107 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-80e2e1bf-17b7-44cd-969a-1125775ba312 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:05.284104 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-80e2e1bf-17b7-44cd-969a-1125775ba312 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:05.284763 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-80e2e1bf-17b7-44cd-969a-1125775ba312 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:05.425640 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-80e2e1bf-17b7-44cd-969a-1125775ba312 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 26964 microversion: 2.1 time: 0.162549 Nov 15 12:41:05.430810 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 122/237] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:41:05 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 26964 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:41:05.706928 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-aa7db9fa-4a79-44ea-b4f2-c447fce5a06a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:05.721570 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-aa7db9fa-4a79-44ea-b4f2-c447fce5a06a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.511672 Nov 15 12:41:05.722406 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 116/238] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:05 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:06.443261 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-f497ca3d-d6e0-49e8-97c3-f6e73ed14a49 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:06.450484 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-f497ca3d-d6e0-49e8-97c3-f6e73ed14a49 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:06.462482 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f497ca3d-d6e0-49e8-97c3-f6e73ed14a49 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:06.462978 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f497ca3d-d6e0-49e8-97c3-f6e73ed14a49 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:06.463779 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f497ca3d-d6e0-49e8-97c3-f6e73ed14a49 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:06.464220 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f497ca3d-d6e0-49e8-97c3-f6e73ed14a49 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:06.622096 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-f497ca3d-d6e0-49e8-97c3-f6e73ed14a49 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 27520 microversion: 2.1 time: 0.184416 Nov 15 12:41:06.627425 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 123/239] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:41:06 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 27520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:41:06.742917 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-8b23c91a-df2a-4635-ba05-2ccdf3c3ea70 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:06.744231 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-8b23c91a-df2a-4635-ba05-2ccdf3c3ea70 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:06.751727 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8b23c91a-df2a-4635-ba05-2ccdf3c3ea70 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:06.752494 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8b23c91a-df2a-4635-ba05-2ccdf3c3ea70 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:06.753515 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8b23c91a-df2a-4635-ba05-2ccdf3c3ea70 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:06.754156 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8b23c91a-df2a-4635-ba05-2ccdf3c3ea70 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:06.912439 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-8b23c91a-df2a-4635-ba05-2ccdf3c3ea70 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:06.925272 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-8b23c91a-df2a-4635-ba05-2ccdf3c3ea70 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.188246 Nov 15 12:41:06.935942 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 117/240] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:06 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:07.635307 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-c1ab9cab-fca5-43e9-863d-a65dc4af9e0f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:07.637177 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-c1ab9cab-fca5-43e9-863d-a65dc4af9e0f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:07.650696 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c1ab9cab-fca5-43e9-863d-a65dc4af9e0f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:07.653351 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c1ab9cab-fca5-43e9-863d-a65dc4af9e0f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:07.655438 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c1ab9cab-fca5-43e9-863d-a65dc4af9e0f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:07.657276 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c1ab9cab-fca5-43e9-863d-a65dc4af9e0f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:07.823609 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-c1ab9cab-fca5-43e9-863d-a65dc4af9e0f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 27758 microversion: 2.1 time: 0.192514 Nov 15 12:41:07.824867 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 124/241] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:41:07 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 27758 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:41:07.947548 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-bf0c9809-67fc-430d-9525-008d52e90bba tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:07.949123 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-bf0c9809-67fc-430d-9525-008d52e90bba tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:07.958657 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bf0c9809-67fc-430d-9525-008d52e90bba tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:07.959344 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bf0c9809-67fc-430d-9525-008d52e90bba tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:07.960843 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bf0c9809-67fc-430d-9525-008d52e90bba tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:07.961439 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bf0c9809-67fc-430d-9525-008d52e90bba tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:08.276656 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-bf0c9809-67fc-430d-9525-008d52e90bba tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:08.287857 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-bf0c9809-67fc-430d-9525-008d52e90bba tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.348574 Nov 15 12:41:08.289525 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 118/242] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:07 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:41:08.836776 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-1cc9facb-4ecc-41af-80b7-a3e9110ce38e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:08.837704 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-1cc9facb-4ecc-41af-80b7-a3e9110ce38e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:08.853648 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1cc9facb-4ecc-41af-80b7-a3e9110ce38e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:08.854106 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1cc9facb-4ecc-41af-80b7-a3e9110ce38e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:08.856608 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1cc9facb-4ecc-41af-80b7-a3e9110ce38e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:08.857150 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1cc9facb-4ecc-41af-80b7-a3e9110ce38e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:09.345700 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-dd384d5c-c87a-4456-8e06-aa93c2f7eae1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'create', calling method: .version_select at 0x7f131b53c3a0>, body: {"keypair": {"name": "tempest-keypair-1261389376"}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:09.361812 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-dd384d5c-c87a-4456-8e06-aa93c2f7eae1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Getting quotas for project 811d24506f5a47d0925645d4303dac8d. Resources: {'key_pairs'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:41:09.366653 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-dd384d5c-c87a-4456-8e06-aa93c2f7eae1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Getting quotas for user 93fd9736646548b383d0c2600219c4f3 and project 811d24506f5a47d0925645d4303dac8d. Resources: {'key_pairs'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:41:09.565189 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-dd384d5c-c87a-4456-8e06-aa93c2f7eae1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Getting quotas for project 811d24506f5a47d0925645d4303dac8d. Resources: {'key_pairs'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:41:09.575057 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-dd384d5c-c87a-4456-8e06-aa93c2f7eae1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Getting quotas for user 93fd9736646548b383d0c2600219c4f3 and project 811d24506f5a47d0925645d4303dac8d. Resources: {'key_pairs'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:41:09.594145 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-dd384d5c-c87a-4456-8e06-aa93c2f7eae1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.561562 Nov 15 12:41:09.595433 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 119/243] 10.222.0.43 () {62 vars in 1198 bytes} [Mon Nov 15 12:41:09 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 563 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Nov 15 12:41:09.601368 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-7746f2bd-048e-4d51-9e98-82a41729e745 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:09.602125 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-7746f2bd-048e-4d51-9e98-82a41729e745 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:09.609057 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7746f2bd-048e-4d51-9e98-82a41729e745 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:09.609594 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7746f2bd-048e-4d51-9e98-82a41729e745 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:09.610369 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7746f2bd-048e-4d51-9e98-82a41729e745 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:09.610980 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7746f2bd-048e-4d51-9e98-82a41729e745 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:09.842102 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-7746f2bd-048e-4d51-9e98-82a41729e745 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:09.851920 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-7746f2bd-048e-4d51-9e98-82a41729e745 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.254771 Nov 15 12:41:09.853225 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 120/244] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:09 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:10.872006 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-8bda6ca0-145d-433a-abe8-a6ab92c9e86a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:10.873300 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-8bda6ca0-145d-433a-abe8-a6ab92c9e86a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:10.881701 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8bda6ca0-145d-433a-abe8-a6ab92c9e86a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:10.882145 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8bda6ca0-145d-433a-abe8-a6ab92c9e86a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:10.886990 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8bda6ca0-145d-433a-abe8-a6ab92c9e86a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:10.887800 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8bda6ca0-145d-433a-abe8-a6ab92c9e86a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:11.086131 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-8bda6ca0-145d-433a-abe8-a6ab92c9e86a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:11.096263 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-8bda6ca0-145d-433a-abe8-a6ab92c9e86a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.228364 Nov 15 12:41:11.097411 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 121/245] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:10 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:41:11.115782 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-1dcf741d-9b4f-49a9-b034-50231c629fe0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1848900542", "imageRef": "3cc21e2c-27da-4266-be76-369023341c16", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f0a2cb68-3063-4051-80f9-d2c4ff88f485"}], "security_groups": [{"name": "tempest-securitygroup--854499085"}], "key_name": "tempest-keypair-1261389376", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:11.431547 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-1cc9facb-4ecc-41af-80b7-a3e9110ce38e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 28181 microversion: 2.1 time: 2.599159 Nov 15 12:41:11.432224 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 125/246] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:41:08 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 28181 bytes in 2601 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:41:12.114247 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-433c5d95-2d77-4b5b-aef0-5b48485fe776 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:12.114982 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-433c5d95-2d77-4b5b-aef0-5b48485fe776 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:12.122458 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-433c5d95-2d77-4b5b-aef0-5b48485fe776 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:12.122939 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-433c5d95-2d77-4b5b-aef0-5b48485fe776 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:12.124260 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-433c5d95-2d77-4b5b-aef0-5b48485fe776 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:12.124683 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-433c5d95-2d77-4b5b-aef0-5b48485fe776 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:12.269366 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-433c5d95-2d77-4b5b-aef0-5b48485fe776 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:12.277718 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-433c5d95-2d77-4b5b-aef0-5b48485fe776 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.167510 Nov 15 12:41:12.278568 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 126/247] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:12 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:41:12.443468 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-4ab17caa-cccb-40df-b9c1-92963217479f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:12.444283 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-4ab17caa-cccb-40df-b9c1-92963217479f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:12.450986 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4ab17caa-cccb-40df-b9c1-92963217479f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:12.451508 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4ab17caa-cccb-40df-b9c1-92963217479f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:12.452250 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4ab17caa-cccb-40df-b9c1-92963217479f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:12.452765 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4ab17caa-cccb-40df-b9c1-92963217479f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:12.560302 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-4ab17caa-cccb-40df-b9c1-92963217479f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 28181 microversion: 2.1 time: 0.120208 Nov 15 12:41:12.561265 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 127/248] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:41:12 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 28181 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:41:13.295934 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e8ee0c00-4bfe-4650-ac2a-b00fe509a865 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:13.296839 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e8ee0c00-4bfe-4650-ac2a-b00fe509a865 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:13.304105 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e8ee0c00-4bfe-4650-ac2a-b00fe509a865 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:13.304630 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e8ee0c00-4bfe-4650-ac2a-b00fe509a865 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:13.305504 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e8ee0c00-4bfe-4650-ac2a-b00fe509a865 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:13.306029 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e8ee0c00-4bfe-4650-ac2a-b00fe509a865 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:13.444961 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e8ee0c00-4bfe-4650-ac2a-b00fe509a865 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:13.452869 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e8ee0c00-4bfe-4650-ac2a-b00fe509a865 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.161067 Nov 15 12:41:13.453506 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 128/249] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:13 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:41:13.573125 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-723ea91c-246c-4a32-a9fd-5593b9a9c39f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:13.574043 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-723ea91c-246c-4a32-a9fd-5593b9a9c39f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:13.581563 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-723ea91c-246c-4a32-a9fd-5593b9a9c39f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:13.582016 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-723ea91c-246c-4a32-a9fd-5593b9a9c39f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:13.582842 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-723ea91c-246c-4a32-a9fd-5593b9a9c39f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:13.583269 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-723ea91c-246c-4a32-a9fd-5593b9a9c39f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:16.370505 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-723ea91c-246c-4a32-a9fd-5593b9a9c39f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 28181 microversion: 2.1 time: 2.802088 Nov 15 12:41:16.375769 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 129/250] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:41:13 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 28181 bytes in 2804 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:41:16.376569 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-18b4d058-1dcd-4b62-bb2a-76e8ecf0e431 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:16.377269 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-18b4d058-1dcd-4b62-bb2a-76e8ecf0e431 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:16.384078 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-18b4d058-1dcd-4b62-bb2a-76e8ecf0e431 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:16.384528 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-18b4d058-1dcd-4b62-bb2a-76e8ecf0e431 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:16.385305 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-18b4d058-1dcd-4b62-bb2a-76e8ecf0e431 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:16.385743 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-18b4d058-1dcd-4b62-bb2a-76e8ecf0e431 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:16.526349 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-18b4d058-1dcd-4b62-bb2a-76e8ecf0e431 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:16.534688 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-18b4d058-1dcd-4b62-bb2a-76e8ecf0e431 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.162078 Nov 15 12:41:16.535308 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 130/251] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:16 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:17.383723 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-58aa9bd4-f643-4f63-8846-55eeaa10b957 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:17.385590 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-58aa9bd4-f643-4f63-8846-55eeaa10b957 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:17.393628 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-58aa9bd4-f643-4f63-8846-55eeaa10b957 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:17.394076 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-58aa9bd4-f643-4f63-8846-55eeaa10b957 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:17.395573 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-58aa9bd4-f643-4f63-8846-55eeaa10b957 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:17.396236 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-58aa9bd4-f643-4f63-8846-55eeaa10b957 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:17.518811 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-58aa9bd4-f643-4f63-8846-55eeaa10b957 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 28472 microversion: 2.1 time: 0.138840 Nov 15 12:41:17.519464 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 131/252] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:41:17 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 28472 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:41:17.553125 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e4564d98-c6d5-4a8a-9f84-cb5e9b71d9d1 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:17.553817 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e4564d98-c6d5-4a8a-9f84-cb5e9b71d9d1 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:17.560919 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e4564d98-c6d5-4a8a-9f84-cb5e9b71d9d1 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:17.561582 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e4564d98-c6d5-4a8a-9f84-cb5e9b71d9d1 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:17.562362 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e4564d98-c6d5-4a8a-9f84-cb5e9b71d9d1 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:17.562841 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e4564d98-c6d5-4a8a-9f84-cb5e9b71d9d1 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:17.747155 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e4564d98-c6d5-4a8a-9f84-cb5e9b71d9d1 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:17.754980 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e4564d98-c6d5-4a8a-9f84-cb5e9b71d9d1 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.206332 Nov 15 12:41:17.755560 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 132/253] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:17 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:41:18.355076 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.network.neutron [None req-1dcf741d-9b4f-49a9-b034-50231c629fe0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] validate_networks() for [('f0a2cb68-3063-4051-80f9-d2c4ff88f485', None, None, None, None, None)] {{(pid=122568) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 15 12:41:18.533542 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-649605eb-7982-4dab-b806-a4b24e4c07c5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:18.535259 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-649605eb-7982-4dab-b806-a4b24e4c07c5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:18.544043 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-649605eb-7982-4dab-b806-a4b24e4c07c5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:18.544591 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-649605eb-7982-4dab-b806-a4b24e4c07c5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:18.546055 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-649605eb-7982-4dab-b806-a4b24e4c07c5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:18.546494 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-649605eb-7982-4dab-b806-a4b24e4c07c5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:18.859081 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-1dcf741d-9b4f-49a9-b034-50231c629fe0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Flavor limits 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 15 12:41:18.859675 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-1dcf741d-9b4f-49a9-b034-50231c629fe0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Image limits 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 15 12:41:18.860125 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-1dcf741d-9b4f-49a9-b034-50231c629fe0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Flavor pref 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 15 12:41:18.860717 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-1dcf741d-9b4f-49a9-b034-50231c629fe0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Image pref 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 15 12:41:18.861248 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-1dcf741d-9b4f-49a9-b034-50231c629fe0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 15 12:41:18.869939 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1dcf741d-9b4f-49a9-b034-50231c629fe0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:18.870372 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1dcf741d-9b4f-49a9-b034-50231c629fe0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:18.871206 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1dcf741d-9b4f-49a9-b034-50231c629fe0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:18.871628 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1dcf741d-9b4f-49a9-b034-50231c629fe0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:18.890262 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-1dcf741d-9b4f-49a9-b034-50231c629fe0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Getting quotas for project 811d24506f5a47d0925645d4303dac8d. Resources: {'cores', 'ram', 'instances'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:41:18.894863 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-1dcf741d-9b4f-49a9-b034-50231c629fe0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Getting quotas for user 93fd9736646548b383d0c2600219c4f3 and project 811d24506f5a47d0925645d4303dac8d. Resources: {'cores', 'ram', 'instances'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:41:18.908365 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-1dcf741d-9b4f-49a9-b034-50231c629fe0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Going to run 1 instances... {{(pid=122568) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 15 12:41:18.911150 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-1dcf741d-9b4f-49a9-b034-50231c629fe0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3cc21e2c-27da-4266-be76-369023341c16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 15 12:41:18.961025 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-1dcf741d-9b4f-49a9-b034-50231c629fe0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 7.849600 Nov 15 12:41:18.961971 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 122/254] 10.222.0.43 () {62 vars in 1187 bytes} [Mon Nov 15 12:41:11 2021] POST /compute/v2.1/servers => generated 401 bytes in 7851 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 15 12:41:18.968244 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-8a1c1b66-f0da-403a-857b-248dafb30325 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:18.968854 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-8a1c1b66-f0da-403a-857b-248dafb30325 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:18.975373 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8a1c1b66-f0da-403a-857b-248dafb30325 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:18.975816 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8a1c1b66-f0da-403a-857b-248dafb30325 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:18.976598 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8a1c1b66-f0da-403a-857b-248dafb30325 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:18.979787 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8a1c1b66-f0da-403a-857b-248dafb30325 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:19.142979 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-8a1c1b66-f0da-403a-857b-248dafb30325 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:19.150524 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-8a1c1b66-f0da-403a-857b-248dafb30325 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.187363 Nov 15 12:41:19.151379 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 123/255] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:18 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:19.164586 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-5dc5179f-621e-4e7f-91f2-ee058dcb20bd tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:19.165138 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-5dc5179f-621e-4e7f-91f2-ee058dcb20bd tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:19.226821 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-5dc5179f-621e-4e7f-91f2-ee058dcb20bd tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:19.235321 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-5dc5179f-621e-4e7f-91f2-ee058dcb20bd tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:19.237923 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-5dc5179f-621e-4e7f-91f2-ee058dcb20bd tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:19.239602 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-5dc5179f-621e-4e7f-91f2-ee058dcb20bd tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1282 microversion: 2.20 time: 0.086972 Nov 15 12:41:19.240443 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 124/256] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:41:19 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1282 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:41:20.168239 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-9e3ce915-5834-4c92-8b15-01c126316e34 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:20.168855 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-9e3ce915-5834-4c92-8b15-01c126316e34 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:20.176112 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9e3ce915-5834-4c92-8b15-01c126316e34 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:20.176550 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9e3ce915-5834-4c92-8b15-01c126316e34 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:20.177402 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9e3ce915-5834-4c92-8b15-01c126316e34 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:20.177752 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9e3ce915-5834-4c92-8b15-01c126316e34 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:20.318978 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-9e3ce915-5834-4c92-8b15-01c126316e34 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:20.326252 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-9e3ce915-5834-4c92-8b15-01c126316e34 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.161495 Nov 15 12:41:20.327414 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 125/257] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:20 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:41:20.331630 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-98e9fe0a-8af4-4e0b-804a-e4cd23271e0a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:20.332436 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-98e9fe0a-8af4-4e0b-804a-e4cd23271e0a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:20.338059 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-98e9fe0a-8af4-4e0b-804a-e4cd23271e0a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:20.338493 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-98e9fe0a-8af4-4e0b-804a-e4cd23271e0a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:20.339449 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-98e9fe0a-8af4-4e0b-804a-e4cd23271e0a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:20.339876 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-98e9fe0a-8af4-4e0b-804a-e4cd23271e0a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:20.398782 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-98e9fe0a-8af4-4e0b-804a-e4cd23271e0a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:20.406724 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-98e9fe0a-8af4-4e0b-804a-e4cd23271e0a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:20.408236 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-98e9fe0a-8af4-4e0b-804a-e4cd23271e0a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:20.409354 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-98e9fe0a-8af4-4e0b-804a-e4cd23271e0a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1286 microversion: 2.20 time: 0.081017 Nov 15 12:41:20.409914 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 126/258] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:41:20 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1286 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:41:20.655715 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-649605eb-7982-4dab-b806-a4b24e4c07c5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 28472 microversion: 2.1 time: 2.128427 Nov 15 12:41:20.656348 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 133/259] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:41:18 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 28472 bytes in 2130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:41:21.344901 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-40ae7117-c03d-43f2-9395-38ea5718ee37 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:21.345519 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-40ae7117-c03d-43f2-9395-38ea5718ee37 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:21.353697 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-40ae7117-c03d-43f2-9395-38ea5718ee37 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:21.354146 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-40ae7117-c03d-43f2-9395-38ea5718ee37 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:21.355153 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-40ae7117-c03d-43f2-9395-38ea5718ee37 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:21.356533 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-40ae7117-c03d-43f2-9395-38ea5718ee37 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:21.428817 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-9ca9a9c4-1a58-4bb1-8533-95edb96737b5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:21.429770 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-9ca9a9c4-1a58-4bb1-8533-95edb96737b5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:21.441152 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9ca9a9c4-1a58-4bb1-8533-95edb96737b5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:21.441957 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9ca9a9c4-1a58-4bb1-8533-95edb96737b5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:21.443012 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9ca9a9c4-1a58-4bb1-8533-95edb96737b5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:21.443594 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9ca9a9c4-1a58-4bb1-8533-95edb96737b5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:21.553223 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-9ca9a9c4-1a58-4bb1-8533-95edb96737b5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:21.570415 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-9ca9a9c4-1a58-4bb1-8533-95edb96737b5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:21.572118 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-9ca9a9c4-1a58-4bb1-8533-95edb96737b5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:21.573462 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-9ca9a9c4-1a58-4bb1-8533-95edb96737b5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1352 microversion: 2.20 time: 0.149547 Nov 15 12:41:21.574198 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 134/260] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:41:21 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1352 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:41:21.667565 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-a511706c-1609-4338-857c-b4c8574a6a56 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:21.668805 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-a511706c-1609-4338-857c-b4c8574a6a56 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:21.676254 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a511706c-1609-4338-857c-b4c8574a6a56 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:21.676942 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a511706c-1609-4338-857c-b4c8574a6a56 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:21.677954 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a511706c-1609-4338-857c-b4c8574a6a56 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:21.678475 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a511706c-1609-4338-857c-b4c8574a6a56 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:21.746948 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-40ae7117-c03d-43f2-9395-38ea5718ee37 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:21.757675 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-40ae7117-c03d-43f2-9395-38ea5718ee37 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.417276 Nov 15 12:41:21.758262 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 127/261] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:21 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:21.812508 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-a511706c-1609-4338-857c-b4c8574a6a56 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 28472 microversion: 2.1 time: 0.148782 Nov 15 12:41:21.813401 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 135/262] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:41:21 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 28472 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:41:22.596549 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-aed457f2-53e4-4048-93aa-c63d1a33a332 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:22.598046 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-aed457f2-53e4-4048-93aa-c63d1a33a332 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:22.604690 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-aed457f2-53e4-4048-93aa-c63d1a33a332 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:22.605490 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-aed457f2-53e4-4048-93aa-c63d1a33a332 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:22.606659 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-aed457f2-53e4-4048-93aa-c63d1a33a332 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:22.607634 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-aed457f2-53e4-4048-93aa-c63d1a33a332 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:22.777427 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-87024c54-aed3-4a8a-a0e3-e92c69619cae tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:22.778226 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-87024c54-aed3-4a8a-a0e3-e92c69619cae tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:22.794665 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-87024c54-aed3-4a8a-a0e3-e92c69619cae tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:22.796738 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-87024c54-aed3-4a8a-a0e3-e92c69619cae tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:22.800039 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-87024c54-aed3-4a8a-a0e3-e92c69619cae tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:22.802086 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-87024c54-aed3-4a8a-a0e3-e92c69619cae tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:22.939793 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-aed457f2-53e4-4048-93aa-c63d1a33a332 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:22.956176 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-aed457f2-53e4-4048-93aa-c63d1a33a332 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:22.958014 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-aed457f2-53e4-4048-93aa-c63d1a33a332 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:22.959344 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-aed457f2-53e4-4048-93aa-c63d1a33a332 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1407 microversion: 2.20 time: 0.369205 Nov 15 12:41:22.960404 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 128/263] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:41:22 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1407 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:41:22.965960 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-0950ae3b-7ef9-4691-adb7-493d84055bc9 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:22.967760 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-0950ae3b-7ef9-4691-adb7-493d84055bc9 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:22.984874 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0950ae3b-7ef9-4691-adb7-493d84055bc9 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:22.985294 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0950ae3b-7ef9-4691-adb7-493d84055bc9 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:22.986373 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0950ae3b-7ef9-4691-adb7-493d84055bc9 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:22.986990 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0950ae3b-7ef9-4691-adb7-493d84055bc9 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:23.113356 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-0950ae3b-7ef9-4691-adb7-493d84055bc9 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 28639 microversion: 2.1 time: 0.151421 Nov 15 12:41:23.114252 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 129/264] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:41:22 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 28639 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:41:23.130663 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-87024c54-aed3-4a8a-a0e3-e92c69619cae tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:23.155089 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-87024c54-aed3-4a8a-a0e3-e92c69619cae tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.381201 Nov 15 12:41:23.156332 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 136/265] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:22 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:23.440951 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-685be9d3-847b-40a9-852d-30b1c730e75d req-c3936a83-a8e6-4a52-a0ca-83327671a901 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11daa0bc-1e25-47d7-a6df-ffc808e1ff58", "tag": "7a90a770-a011-4cb6-9fcf-893773b8d120"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:23.442539 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:41:23.442539 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:41:23.451886 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-685be9d3-847b-40a9-852d-30b1c730e75d req-c3936a83-a8e6-4a52-a0ca-83327671a901 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:23.453301 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-685be9d3-847b-40a9-852d-30b1c730e75d req-c3936a83-a8e6-4a52-a0ca-83327671a901 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:23.471876 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-685be9d3-847b-40a9-852d-30b1c730e75d req-c3936a83-a8e6-4a52-a0ca-83327671a901 service nova] Creating event network-changed:7a90a770-a011-4cb6-9fcf-893773b8d120 for instance 11daa0bc-1e25-47d7-a6df-ffc808e1ff58 on hv-cinder-68088 Nov 15 12:41:23.492984 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-685be9d3-847b-40a9-852d-30b1c730e75d req-c3936a83-a8e6-4a52-a0ca-83327671a901 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056145 Nov 15 12:41:23.493675 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 130/266] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:41:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:41:23.978870 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-7e063c20-32ca-4bf8-8807-330ab987fa47 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:23.980247 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-7e063c20-32ca-4bf8-8807-330ab987fa47 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:23.987601 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7e063c20-32ca-4bf8-8807-330ab987fa47 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:23.988048 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7e063c20-32ca-4bf8-8807-330ab987fa47 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:23.988833 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7e063c20-32ca-4bf8-8807-330ab987fa47 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:23.989277 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7e063c20-32ca-4bf8-8807-330ab987fa47 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:24.127696 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-c30e0a9e-2580-48cc-a63f-cba9b038269a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:24.129399 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-c30e0a9e-2580-48cc-a63f-cba9b038269a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:24.142050 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c30e0a9e-2580-48cc-a63f-cba9b038269a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:24.142838 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c30e0a9e-2580-48cc-a63f-cba9b038269a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:24.143690 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c30e0a9e-2580-48cc-a63f-cba9b038269a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:24.144114 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c30e0a9e-2580-48cc-a63f-cba9b038269a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:24.268701 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-c30e0a9e-2580-48cc-a63f-cba9b038269a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 28639 microversion: 2.1 time: 0.144095 Nov 15 12:41:24.269637 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 131/267] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:41:24 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 28639 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:41:24.275906 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-ec914a75-23cb-45bf-ae3f-f9bef29ebd61 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:24.294749 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-ec914a75-23cb-45bf-ae3f-f9bef29ebd61 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:24.307872 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ec914a75-23cb-45bf-ae3f-f9bef29ebd61 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:24.308622 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ec914a75-23cb-45bf-ae3f-f9bef29ebd61 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:24.309630 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ec914a75-23cb-45bf-ae3f-f9bef29ebd61 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:24.310221 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ec914a75-23cb-45bf-ae3f-f9bef29ebd61 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:24.522288 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-7e063c20-32ca-4bf8-8807-330ab987fa47 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:24.535171 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-7e063c20-32ca-4bf8-8807-330ab987fa47 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:24.538410 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-7e063c20-32ca-4bf8-8807-330ab987fa47 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:24.539591 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-7e063c20-32ca-4bf8-8807-330ab987fa47 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1407 microversion: 2.20 time: 0.564693 Nov 15 12:41:24.540169 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 137/268] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:41:23 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1407 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:41:24.721960 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-ec914a75-23cb-45bf-ae3f-f9bef29ebd61 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:24.739383 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-ec914a75-23cb-45bf-ae3f-f9bef29ebd61 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1522 microversion: 2.1 time: 0.467810 Nov 15 12:41:24.744674 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 132/269] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:24 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1522 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:25.281307 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-184c742e-e0d3-4a9a-9aba-2588a588baa2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:25.282191 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-184c742e-e0d3-4a9a-9aba-2588a588baa2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:25.288949 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-184c742e-e0d3-4a9a-9aba-2588a588baa2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:25.289411 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-184c742e-e0d3-4a9a-9aba-2588a588baa2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:25.290229 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-184c742e-e0d3-4a9a-9aba-2588a588baa2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:25.290849 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-184c742e-e0d3-4a9a-9aba-2588a588baa2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:25.560803 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-bfd2e1d0-2b30-42cc-81d7-3a608e81ecf1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:25.561744 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-bfd2e1d0-2b30-42cc-81d7-3a608e81ecf1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:25.568799 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bfd2e1d0-2b30-42cc-81d7-3a608e81ecf1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:25.569252 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bfd2e1d0-2b30-42cc-81d7-3a608e81ecf1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:25.570025 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bfd2e1d0-2b30-42cc-81d7-3a608e81ecf1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:25.570455 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bfd2e1d0-2b30-42cc-81d7-3a608e81ecf1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:25.801116 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-bfd2e1d0-2b30-42cc-81d7-3a608e81ecf1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:25.809592 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-bfd2e1d0-2b30-42cc-81d7-3a608e81ecf1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:25.811169 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-bfd2e1d0-2b30-42cc-81d7-3a608e81ecf1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:25.812246 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-bfd2e1d0-2b30-42cc-81d7-3a608e81ecf1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1407 microversion: 2.20 time: 0.255322 Nov 15 12:41:25.812796 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 133/270] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:41:25 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 15 12:41:25.816979 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-85e1e334-9bfa-4121-9087-adabdfab1929 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:25.817555 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-85e1e334-9bfa-4121-9087-adabdfab1929 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:25.823105 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-85e1e334-9bfa-4121-9087-adabdfab1929 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:25.823538 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-85e1e334-9bfa-4121-9087-adabdfab1929 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:25.824327 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-85e1e334-9bfa-4121-9087-adabdfab1929 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:25.824743 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-85e1e334-9bfa-4121-9087-adabdfab1929 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:25.962567 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-85e1e334-9bfa-4121-9087-adabdfab1929 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:25.970509 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-85e1e334-9bfa-4121-9087-adabdfab1929 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1502 microversion: 2.1 time: 0.156779 Nov 15 12:41:25.971108 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 134/271] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:25 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:25.985934 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-cfccba5d-3913-4ecd-966d-0096f4f35a46 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:25.986471 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-cfccba5d-3913-4ecd-966d-0096f4f35a46 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:25.993017 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-cfccba5d-3913-4ecd-966d-0096f4f35a46 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:25.993479 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-cfccba5d-3913-4ecd-966d-0096f4f35a46 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:25.994227 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-cfccba5d-3913-4ecd-966d-0096f4f35a46 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:25.994657 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-cfccba5d-3913-4ecd-966d-0096f4f35a46 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:26.128308 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-cfccba5d-3913-4ecd-966d-0096f4f35a46 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:26.135761 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-cfccba5d-3913-4ecd-966d-0096f4f35a46 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1515 microversion: 2.1 time: 0.153377 Nov 15 12:41:26.136425 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 135/272] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:25 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:41:26.835315 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-0e5ad8c5-0484-45c6-8b75-0efd3a3ea773 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:26.835973 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-0e5ad8c5-0484-45c6-8b75-0efd3a3ea773 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:26.842318 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0e5ad8c5-0484-45c6-8b75-0efd3a3ea773 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:26.842939 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0e5ad8c5-0484-45c6-8b75-0efd3a3ea773 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:26.843711 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0e5ad8c5-0484-45c6-8b75-0efd3a3ea773 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:26.844138 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0e5ad8c5-0484-45c6-8b75-0efd3a3ea773 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:26.976853 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-0e5ad8c5-0484-45c6-8b75-0efd3a3ea773 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:26.984667 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-0e5ad8c5-0484-45c6-8b75-0efd3a3ea773 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:26.986165 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-0e5ad8c5-0484-45c6-8b75-0efd3a3ea773 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:26.987276 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-0e5ad8c5-0484-45c6-8b75-0efd3a3ea773 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1407 microversion: 2.20 time: 0.155702 Nov 15 12:41:26.987837 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 136/273] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:41:26 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 15 12:41:27.917632 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-184c742e-e0d3-4a9a-9aba-2588a588baa2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 28639 microversion: 2.1 time: 2.640007 Nov 15 12:41:27.918279 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 138/274] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:41:25 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 28639 bytes in 2642 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:41:28.005065 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-52067a3a-94bc-4bac-96f3-2feeca41544d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:28.005635 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-52067a3a-94bc-4bac-96f3-2feeca41544d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:28.011944 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-52067a3a-94bc-4bac-96f3-2feeca41544d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:28.012384 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-52067a3a-94bc-4bac-96f3-2feeca41544d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:28.013149 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-52067a3a-94bc-4bac-96f3-2feeca41544d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:28.013610 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-52067a3a-94bc-4bac-96f3-2feeca41544d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:28.147234 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-52067a3a-94bc-4bac-96f3-2feeca41544d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:28.155572 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-52067a3a-94bc-4bac-96f3-2feeca41544d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:28.157065 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-52067a3a-94bc-4bac-96f3-2feeca41544d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:28.158158 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-52067a3a-94bc-4bac-96f3-2feeca41544d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1407 microversion: 2.20 time: 0.156851 Nov 15 12:41:28.158713 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 137/275] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:41:28 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:41:28.931969 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-cbbe8889-653a-40e5-8dbd-ed1d74242230 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:28.933285 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-cbbe8889-653a-40e5-8dbd-ed1d74242230 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:28.941350 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cbbe8889-653a-40e5-8dbd-ed1d74242230 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:28.941904 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cbbe8889-653a-40e5-8dbd-ed1d74242230 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:28.942930 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cbbe8889-653a-40e5-8dbd-ed1d74242230 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:28.943470 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cbbe8889-653a-40e5-8dbd-ed1d74242230 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:29.044490 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-cbbe8889-653a-40e5-8dbd-ed1d74242230 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 28639 microversion: 2.1 time: 0.117390 Nov 15 12:41:29.049262 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 139/276] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:41:28 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 28639 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:41:29.177855 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-16577065-9c42-478e-9d47-7d489c5d8387 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:29.179319 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-16577065-9c42-478e-9d47-7d489c5d8387 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:29.187816 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-16577065-9c42-478e-9d47-7d489c5d8387 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:29.188284 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-16577065-9c42-478e-9d47-7d489c5d8387 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:29.189360 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-16577065-9c42-478e-9d47-7d489c5d8387 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:29.189829 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-16577065-9c42-478e-9d47-7d489c5d8387 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:29.352268 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-16577065-9c42-478e-9d47-7d489c5d8387 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:29.363080 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-16577065-9c42-478e-9d47-7d489c5d8387 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:29.363080 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-16577065-9c42-478e-9d47-7d489c5d8387 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:29.363967 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-16577065-9c42-478e-9d47-7d489c5d8387 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1407 microversion: 2.20 time: 0.191599 Nov 15 12:41:29.364594 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 138/277] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:41:29 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:41:29.586515 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-df26ae78-c140-447d-ab59-45e79a2269a4 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:29.587552 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-df26ae78-c140-447d-ab59-45e79a2269a4 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:29.595021 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-df26ae78-c140-447d-ab59-45e79a2269a4 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:29.595679 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-df26ae78-c140-447d-ab59-45e79a2269a4 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:29.596621 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-df26ae78-c140-447d-ab59-45e79a2269a4 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:29.597210 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-df26ae78-c140-447d-ab59-45e79a2269a4 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:29.624354 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.objects.instance [None req-df26ae78-c140-447d-ab59-45e79a2269a4 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lazy-loading 'flavor' on Instance uuid aea00c4f-da8f-4b9e-8c12-7ebe91776986 {{(pid=122567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 15 12:41:29.753978 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-df26ae78-c140-447d-ab59-45e79a2269a4 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "POST /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986/action" status: 200 len: 32 microversion: 2.1 time: 0.171427 Nov 15 12:41:29.755078 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 140/278] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:41:29 2021] POST /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986/action => generated 32 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 15 12:41:29.764700 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-8aae929f-6450-4d5a-9e70-47150d5e0b71 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:29.765430 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-8aae929f-6450-4d5a-9e70-47150d5e0b71 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:29.771946 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8aae929f-6450-4d5a-9e70-47150d5e0b71 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:29.772501 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8aae929f-6450-4d5a-9e70-47150d5e0b71 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:29.773488 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8aae929f-6450-4d5a-9e70-47150d5e0b71 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:29.774175 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8aae929f-6450-4d5a-9e70-47150d5e0b71 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:30.007004 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-8aae929f-6450-4d5a-9e70-47150d5e0b71 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:30.017327 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-8aae929f-6450-4d5a-9e70-47150d5e0b71 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1521 microversion: 2.1 time: 0.256674 Nov 15 12:41:30.018081 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 139/279] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:29 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:30.057320 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-5e7e8137-79c9-48cb-858e-700bbc7eaa9e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:30.058361 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-5e7e8137-79c9-48cb-858e-700bbc7eaa9e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:30.066971 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5e7e8137-79c9-48cb-858e-700bbc7eaa9e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:30.067661 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5e7e8137-79c9-48cb-858e-700bbc7eaa9e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:30.068439 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5e7e8137-79c9-48cb-858e-700bbc7eaa9e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:30.069026 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5e7e8137-79c9-48cb-858e-700bbc7eaa9e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:30.168707 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-5e7e8137-79c9-48cb-858e-700bbc7eaa9e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 28639 microversion: 2.1 time: 0.115131 Nov 15 12:41:30.169798 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 141/280] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:41:30 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 28639 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:41:30.384389 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-cbefc68f-b9de-4fdf-a1c1-e1ae25284a7b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:30.386217 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-cbefc68f-b9de-4fdf-a1c1-e1ae25284a7b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:30.394252 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-cbefc68f-b9de-4fdf-a1c1-e1ae25284a7b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:30.394698 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-cbefc68f-b9de-4fdf-a1c1-e1ae25284a7b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:30.395510 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-cbefc68f-b9de-4fdf-a1c1-e1ae25284a7b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:30.396100 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-cbefc68f-b9de-4fdf-a1c1-e1ae25284a7b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:30.540684 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-cbefc68f-b9de-4fdf-a1c1-e1ae25284a7b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:30.549430 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-cbefc68f-b9de-4fdf-a1c1-e1ae25284a7b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:30.551082 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-cbefc68f-b9de-4fdf-a1c1-e1ae25284a7b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:30.552199 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-cbefc68f-b9de-4fdf-a1c1-e1ae25284a7b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1407 microversion: 2.20 time: 0.172715 Nov 15 12:41:30.552869 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 140/281] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:41:30 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:41:31.036928 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-14cf185e-0ef9-4d82-b9a5-0a1a1a631386 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:31.037615 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-14cf185e-0ef9-4d82-b9a5-0a1a1a631386 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:31.044566 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-14cf185e-0ef9-4d82-b9a5-0a1a1a631386 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:31.045768 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-14cf185e-0ef9-4d82-b9a5-0a1a1a631386 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:31.046715 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-14cf185e-0ef9-4d82-b9a5-0a1a1a631386 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:31.047183 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-14cf185e-0ef9-4d82-b9a5-0a1a1a631386 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:31.181929 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-6643577f-680d-4854-a294-aa67ff3fe843 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:31.182998 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-6643577f-680d-4854-a294-aa67ff3fe843 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:31.189041 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-14cf185e-0ef9-4d82-b9a5-0a1a1a631386 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:31.190167 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6643577f-680d-4854-a294-aa67ff3fe843 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:31.190608 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6643577f-680d-4854-a294-aa67ff3fe843 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:31.193916 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6643577f-680d-4854-a294-aa67ff3fe843 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:31.193916 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6643577f-680d-4854-a294-aa67ff3fe843 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:31.202902 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-14cf185e-0ef9-4d82-b9a5-0a1a1a631386 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1521 microversion: 2.1 time: 0.169978 Nov 15 12:41:31.209938 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 142/282] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:31 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:31.570581 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e73e0817-b24c-4fdb-9eb3-87c9ea731876 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:31.571309 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e73e0817-b24c-4fdb-9eb3-87c9ea731876 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:31.577565 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e73e0817-b24c-4fdb-9eb3-87c9ea731876 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:31.578083 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e73e0817-b24c-4fdb-9eb3-87c9ea731876 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:31.578966 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e73e0817-b24c-4fdb-9eb3-87c9ea731876 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:31.579557 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e73e0817-b24c-4fdb-9eb3-87c9ea731876 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:31.726277 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e73e0817-b24c-4fdb-9eb3-87c9ea731876 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:31.734490 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e73e0817-b24c-4fdb-9eb3-87c9ea731876 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:31.736262 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e73e0817-b24c-4fdb-9eb3-87c9ea731876 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:31.737381 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e73e0817-b24c-4fdb-9eb3-87c9ea731876 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1407 microversion: 2.20 time: 0.170508 Nov 15 12:41:31.738088 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 143/283] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:41:31 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 15 12:41:32.223759 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-21509c92-70c3-4c6f-8772-7632c7949207 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:32.224418 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-21509c92-70c3-4c6f-8772-7632c7949207 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:32.230613 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-21509c92-70c3-4c6f-8772-7632c7949207 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:32.231072 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-21509c92-70c3-4c6f-8772-7632c7949207 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:32.231854 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-21509c92-70c3-4c6f-8772-7632c7949207 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:32.232398 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-21509c92-70c3-4c6f-8772-7632c7949207 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:32.373980 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-21509c92-70c3-4c6f-8772-7632c7949207 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:32.381399 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-21509c92-70c3-4c6f-8772-7632c7949207 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1521 microversion: 2.1 time: 0.161367 Nov 15 12:41:32.382056 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 144/284] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:32 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:41:32.755090 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-ba4ac037-110c-4152-99bb-88ee3309fa68 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:32.755703 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-ba4ac037-110c-4152-99bb-88ee3309fa68 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:32.761950 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ba4ac037-110c-4152-99bb-88ee3309fa68 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:32.762393 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ba4ac037-110c-4152-99bb-88ee3309fa68 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:32.763201 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ba4ac037-110c-4152-99bb-88ee3309fa68 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:32.763790 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ba4ac037-110c-4152-99bb-88ee3309fa68 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:32.943424 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-ba4ac037-110c-4152-99bb-88ee3309fa68 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:32.952851 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-ba4ac037-110c-4152-99bb-88ee3309fa68 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:32.954899 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-ba4ac037-110c-4152-99bb-88ee3309fa68 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:32.956020 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-ba4ac037-110c-4152-99bb-88ee3309fa68 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1407 microversion: 2.20 time: 0.204589 Nov 15 12:41:32.956580 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 145/285] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:41:32 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 15 12:41:33.398351 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-02401e10-e904-42c9-8d6d-0dc6ecf6e004 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:33.399051 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-02401e10-e904-42c9-8d6d-0dc6ecf6e004 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:33.405364 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-02401e10-e904-42c9-8d6d-0dc6ecf6e004 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:33.405824 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-02401e10-e904-42c9-8d6d-0dc6ecf6e004 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:33.406597 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-02401e10-e904-42c9-8d6d-0dc6ecf6e004 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:33.407052 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-02401e10-e904-42c9-8d6d-0dc6ecf6e004 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:33.540793 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-02401e10-e904-42c9-8d6d-0dc6ecf6e004 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:33.549112 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-02401e10-e904-42c9-8d6d-0dc6ecf6e004 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1521 microversion: 2.1 time: 0.154121 Nov 15 12:41:33.554986 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 146/286] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:33 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:41:33.555327 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-6643577f-680d-4854-a294-aa67ff3fe843 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 28639 microversion: 2.1 time: 2.375732 Nov 15 12:41:33.555327 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 141/287] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:41:31 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 28639 bytes in 2377 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:41:33.973542 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-54839d7d-c8f1-4277-9568-9ed1d3090eb1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:33.974145 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-54839d7d-c8f1-4277-9568-9ed1d3090eb1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:33.980555 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-54839d7d-c8f1-4277-9568-9ed1d3090eb1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:33.981002 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-54839d7d-c8f1-4277-9568-9ed1d3090eb1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:33.981785 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-54839d7d-c8f1-4277-9568-9ed1d3090eb1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:33.982275 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-54839d7d-c8f1-4277-9568-9ed1d3090eb1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:34.127572 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-54839d7d-c8f1-4277-9568-9ed1d3090eb1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:34.135415 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-54839d7d-c8f1-4277-9568-9ed1d3090eb1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:34.136907 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-54839d7d-c8f1-4277-9568-9ed1d3090eb1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:34.137987 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-54839d7d-c8f1-4277-9568-9ed1d3090eb1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1407 microversion: 2.20 time: 0.168139 Nov 15 12:41:34.139049 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 147/288] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:41:33 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:41:34.565544 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-0bfc2514-234c-403d-a0b0-4fa865b82477 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:34.566166 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-050443b4-5a2c-4d22-a249-09a7596462b0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:34.566524 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-0bfc2514-234c-403d-a0b0-4fa865b82477 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:34.566614 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-050443b4-5a2c-4d22-a249-09a7596462b0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:34.572474 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0bfc2514-234c-403d-a0b0-4fa865b82477 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:34.572926 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0bfc2514-234c-403d-a0b0-4fa865b82477 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:34.573190 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-050443b4-5a2c-4d22-a249-09a7596462b0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:34.573629 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-050443b4-5a2c-4d22-a249-09a7596462b0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:34.573728 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0bfc2514-234c-403d-a0b0-4fa865b82477 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:34.574128 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0bfc2514-234c-403d-a0b0-4fa865b82477 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:34.574424 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-050443b4-5a2c-4d22-a249-09a7596462b0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:34.574872 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-050443b4-5a2c-4d22-a249-09a7596462b0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:34.688908 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-0bfc2514-234c-403d-a0b0-4fa865b82477 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 28639 microversion: 2.1 time: 0.126672 Nov 15 12:41:34.689787 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 148/289] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:41:34 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 28639 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:41:34.737212 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-050443b4-5a2c-4d22-a249-09a7596462b0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:34.744519 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-050443b4-5a2c-4d22-a249-09a7596462b0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1521 microversion: 2.1 time: 0.182639 Nov 15 12:41:34.745080 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 142/290] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:34 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:35.157233 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e1b0f5b6-102d-439e-88f6-49ae27b61a0e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:35.158196 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e1b0f5b6-102d-439e-88f6-49ae27b61a0e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:35.165135 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e1b0f5b6-102d-439e-88f6-49ae27b61a0e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:35.165580 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e1b0f5b6-102d-439e-88f6-49ae27b61a0e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:35.166377 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e1b0f5b6-102d-439e-88f6-49ae27b61a0e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:35.166863 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e1b0f5b6-102d-439e-88f6-49ae27b61a0e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:35.302704 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e1b0f5b6-102d-439e-88f6-49ae27b61a0e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:35.310483 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e1b0f5b6-102d-439e-88f6-49ae27b61a0e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:35.312001 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e1b0f5b6-102d-439e-88f6-49ae27b61a0e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:35.313087 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e1b0f5b6-102d-439e-88f6-49ae27b61a0e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1407 microversion: 2.20 time: 0.160177 Nov 15 12:41:35.313626 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 149/291] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:41:35 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:41:35.693056 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-98617925-cafb-4e7d-8a9f-5063bdc13605 req-11495753-d223-4380-b8e2-e7c1b83e1571 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11daa0bc-1e25-47d7-a6df-ffc808e1ff58", "name": "network-vif-plugged", "status": "completed", "tag": "7a90a770-a011-4cb6-9fcf-893773b8d120"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:35.695701 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:41:35.695701 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:41:35.706518 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-59997569-b176-4f0c-b5ba-b726afc7818c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:35.707708 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-98617925-cafb-4e7d-8a9f-5063bdc13605 req-11495753-d223-4380-b8e2-e7c1b83e1571 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:35.708397 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-98617925-cafb-4e7d-8a9f-5063bdc13605 req-11495753-d223-4380-b8e2-e7c1b83e1571 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:35.708703 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-59997569-b176-4f0c-b5ba-b726afc7818c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:35.717082 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-59997569-b176-4f0c-b5ba-b726afc7818c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:35.717697 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-59997569-b176-4f0c-b5ba-b726afc7818c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:35.719245 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-59997569-b176-4f0c-b5ba-b726afc7818c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:35.720193 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-59997569-b176-4f0c-b5ba-b726afc7818c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:35.721535 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-98617925-cafb-4e7d-8a9f-5063bdc13605 req-11495753-d223-4380-b8e2-e7c1b83e1571 service nova] Creating event network-vif-plugged:7a90a770-a011-4cb6-9fcf-893773b8d120 for instance 11daa0bc-1e25-47d7-a6df-ffc808e1ff58 on hv-cinder-68088 Nov 15 12:41:35.728828 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-98617925-cafb-4e7d-8a9f-5063bdc13605 req-11495753-d223-4380-b8e2-e7c1b83e1571 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040286 Nov 15 12:41:35.730651 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 143/292] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:41:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:41:35.764310 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-d2f4c0a6-19b5-47ee-b010-c684dadd5d59 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:35.765694 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-d2f4c0a6-19b5-47ee-b010-c684dadd5d59 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:35.772984 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d2f4c0a6-19b5-47ee-b010-c684dadd5d59 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:35.773909 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d2f4c0a6-19b5-47ee-b010-c684dadd5d59 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:35.774917 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d2f4c0a6-19b5-47ee-b010-c684dadd5d59 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:35.775393 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d2f4c0a6-19b5-47ee-b010-c684dadd5d59 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:35.868602 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-59997569-b176-4f0c-b5ba-b726afc7818c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 29786 microversion: 2.1 time: 0.169183 Nov 15 12:41:35.869140 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 150/293] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:41:35 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 29786 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:41:35.936935 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-d2f4c0a6-19b5-47ee-b010-c684dadd5d59 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:35.946528 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-d2f4c0a6-19b5-47ee-b010-c684dadd5d59 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1521 microversion: 2.1 time: 0.187392 Nov 15 12:41:35.947479 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 144/294] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:35 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:41:36.334222 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-ec96174d-7ee0-4194-a419-44660171a614 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:36.335067 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-ec96174d-7ee0-4194-a419-44660171a614 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:36.342997 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ec96174d-7ee0-4194-a419-44660171a614 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:36.343579 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ec96174d-7ee0-4194-a419-44660171a614 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:36.344462 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ec96174d-7ee0-4194-a419-44660171a614 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:36.345683 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ec96174d-7ee0-4194-a419-44660171a614 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:36.503919 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-ec96174d-7ee0-4194-a419-44660171a614 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:36.511894 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-ec96174d-7ee0-4194-a419-44660171a614 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:36.514141 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-ec96174d-7ee0-4194-a419-44660171a614 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:36.515072 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-ec96174d-7ee0-4194-a419-44660171a614 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1407 microversion: 2.20 time: 0.186935 Nov 15 12:41:36.515628 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 151/295] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:41:36 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:41:36.880745 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-1c97e3f2-b24a-4812-8f37-e882b175de76 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:36.881665 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-1c97e3f2-b24a-4812-8f37-e882b175de76 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:36.888025 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1c97e3f2-b24a-4812-8f37-e882b175de76 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:36.888545 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1c97e3f2-b24a-4812-8f37-e882b175de76 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:36.890413 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1c97e3f2-b24a-4812-8f37-e882b175de76 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:36.890639 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1c97e3f2-b24a-4812-8f37-e882b175de76 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:36.963555 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-9fe74e1e-9dd0-4f19-8d1e-5f6d722b62d0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:36.964176 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-9fe74e1e-9dd0-4f19-8d1e-5f6d722b62d0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:36.971087 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9fe74e1e-9dd0-4f19-8d1e-5f6d722b62d0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:36.971534 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9fe74e1e-9dd0-4f19-8d1e-5f6d722b62d0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:36.972369 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9fe74e1e-9dd0-4f19-8d1e-5f6d722b62d0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:36.972804 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9fe74e1e-9dd0-4f19-8d1e-5f6d722b62d0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:37.009087 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-1c97e3f2-b24a-4812-8f37-e882b175de76 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 30978 microversion: 2.1 time: 0.131851 Nov 15 12:41:37.009762 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 145/296] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:41:36 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 30978 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:41:37.106541 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-9fe74e1e-9dd0-4f19-8d1e-5f6d722b62d0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:37.115002 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-9fe74e1e-9dd0-4f19-8d1e-5f6d722b62d0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1521 microversion: 2.1 time: 0.155188 Nov 15 12:41:37.115580 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 152/297] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:36 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:41:37.534688 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-5932d1ea-be89-4b0c-a71b-046a85ce9e85 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:37.535569 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-5932d1ea-be89-4b0c-a71b-046a85ce9e85 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:37.543509 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5932d1ea-be89-4b0c-a71b-046a85ce9e85 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:37.544112 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5932d1ea-be89-4b0c-a71b-046a85ce9e85 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:37.545611 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5932d1ea-be89-4b0c-a71b-046a85ce9e85 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:37.546041 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5932d1ea-be89-4b0c-a71b-046a85ce9e85 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:37.712791 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-5932d1ea-be89-4b0c-a71b-046a85ce9e85 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:37.723697 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-5932d1ea-be89-4b0c-a71b-046a85ce9e85 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:37.725863 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-5932d1ea-be89-4b0c-a71b-046a85ce9e85 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:37.727124 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-5932d1ea-be89-4b0c-a71b-046a85ce9e85 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1407 microversion: 2.20 time: 0.198125 Nov 15 12:41:37.737411 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 146/298] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:41:37 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:41:38.021163 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-ede21584-8f53-4636-bd41-2917018fefd2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:38.023375 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-ede21584-8f53-4636-bd41-2917018fefd2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:38.035603 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ede21584-8f53-4636-bd41-2917018fefd2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:38.036052 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ede21584-8f53-4636-bd41-2917018fefd2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:38.036833 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ede21584-8f53-4636-bd41-2917018fefd2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:38.037259 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ede21584-8f53-4636-bd41-2917018fefd2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:38.133250 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-17d910e3-2117-44b4-8cfa-8b899a111c29 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:38.134008 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-17d910e3-2117-44b4-8cfa-8b899a111c29 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:38.140983 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-17d910e3-2117-44b4-8cfa-8b899a111c29 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:38.141852 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-17d910e3-2117-44b4-8cfa-8b899a111c29 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:38.143049 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-17d910e3-2117-44b4-8cfa-8b899a111c29 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:38.143537 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-17d910e3-2117-44b4-8cfa-8b899a111c29 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:38.167648 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-ede21584-8f53-4636-bd41-2917018fefd2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 32346 microversion: 2.1 time: 0.150853 Nov 15 12:41:38.168308 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 153/299] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:41:38 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 32346 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:41:38.420395 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-17d910e3-2117-44b4-8cfa-8b899a111c29 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:38.428126 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-17d910e3-2117-44b4-8cfa-8b899a111c29 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1521 microversion: 2.1 time: 0.298607 Nov 15 12:41:38.438316 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 147/300] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:38 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:41:38.745650 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-a315623d-0860-4164-9acc-8f3d11212e89 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:38.746349 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-a315623d-0860-4164-9acc-8f3d11212e89 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:38.754019 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a315623d-0860-4164-9acc-8f3d11212e89 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:38.754473 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a315623d-0860-4164-9acc-8f3d11212e89 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:38.755304 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a315623d-0860-4164-9acc-8f3d11212e89 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:38.755739 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a315623d-0860-4164-9acc-8f3d11212e89 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:38.925116 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-a315623d-0860-4164-9acc-8f3d11212e89 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:38.936661 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-a315623d-0860-4164-9acc-8f3d11212e89 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:38.938392 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-a315623d-0860-4164-9acc-8f3d11212e89 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:38.939982 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-a315623d-0860-4164-9acc-8f3d11212e89 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1600 microversion: 2.20 time: 0.198425 Nov 15 12:41:38.940692 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 154/301] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:41:38 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1600 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:41:38.958444 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-71e9ae2f-ddbb-4a02-8de2-02d17a4e4b1e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:38.958982 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-71e9ae2f-ddbb-4a02-8de2-02d17a4e4b1e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:38.966251 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-71e9ae2f-ddbb-4a02-8de2-02d17a4e4b1e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:38.967255 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-71e9ae2f-ddbb-4a02-8de2-02d17a4e4b1e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:38.968241 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-71e9ae2f-ddbb-4a02-8de2-02d17a4e4b1e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:38.968995 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-71e9ae2f-ddbb-4a02-8de2-02d17a4e4b1e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:39.089391 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-71e9ae2f-ddbb-4a02-8de2-02d17a4e4b1e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.133167 Nov 15 12:41:39.089391 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 148/302] 10.222.0.43 () {60 vars in 1315 bytes} [Mon Nov 15 12:41:38 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/os-interface => generated 285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:41:39.181369 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-baafef24-2cd1-47b3-8c68-8e7ea752596a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:39.182547 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-baafef24-2cd1-47b3-8c68-8e7ea752596a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:39.189301 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-baafef24-2cd1-47b3-8c68-8e7ea752596a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:39.189903 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-baafef24-2cd1-47b3-8c68-8e7ea752596a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:39.190689 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-baafef24-2cd1-47b3-8c68-8e7ea752596a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:39.191367 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-baafef24-2cd1-47b3-8c68-8e7ea752596a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:39.445376 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-f6e2c331-4124-42bc-8eee-17cd04ce007a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:39.446092 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-f6e2c331-4124-42bc-8eee-17cd04ce007a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:39.452778 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f6e2c331-4124-42bc-8eee-17cd04ce007a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:39.453305 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f6e2c331-4124-42bc-8eee-17cd04ce007a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:39.454124 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f6e2c331-4124-42bc-8eee-17cd04ce007a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:39.454555 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f6e2c331-4124-42bc-8eee-17cd04ce007a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:39.585074 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-f6e2c331-4124-42bc-8eee-17cd04ce007a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:39.593197 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-f6e2c331-4124-42bc-8eee-17cd04ce007a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1521 microversion: 2.1 time: 0.151490 Nov 15 12:41:39.594152 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 149/303] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:39 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:41:40.267607 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-7dcc9adf-bac2-42e8-adb7-9c8cf1a1abf1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:40.268517 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-7dcc9adf-bac2-42e8-adb7-9c8cf1a1abf1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:40.279281 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7dcc9adf-bac2-42e8-adb7-9c8cf1a1abf1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:40.279736 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7dcc9adf-bac2-42e8-adb7-9c8cf1a1abf1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:40.280629 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7dcc9adf-bac2-42e8-adb7-9c8cf1a1abf1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:40.281114 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7dcc9adf-bac2-42e8-adb7-9c8cf1a1abf1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:41.555212 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-7dcc9adf-bac2-42e8-adb7-9c8cf1a1abf1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 14 microversion: 2.20 time: 1.291341 Nov 15 12:41:41.555844 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 150/304] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:41:40 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 14 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:41.561358 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-3e9d018f-c5fa-4d12-9585-468f53249417 req-084872cc-69aa-4489-aea9-95b5d0de3467 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11daa0bc-1e25-47d7-a6df-ffc808e1ff58", "tag": "7a90a770-a011-4cb6-9fcf-893773b8d120"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:41.562856 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:41:41.562856 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:41:41.570474 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-3e9d018f-c5fa-4d12-9585-468f53249417 req-084872cc-69aa-4489-aea9-95b5d0de3467 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:41.570936 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-3e9d018f-c5fa-4d12-9585-468f53249417 req-084872cc-69aa-4489-aea9-95b5d0de3467 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:41.581719 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-3e9d018f-c5fa-4d12-9585-468f53249417 req-084872cc-69aa-4489-aea9-95b5d0de3467 service nova] Creating event network-changed:7a90a770-a011-4cb6-9fcf-893773b8d120 for instance 11daa0bc-1e25-47d7-a6df-ffc808e1ff58 on hv-cinder-68088 Nov 15 12:41:41.586728 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-3e9d018f-c5fa-4d12-9585-468f53249417 req-084872cc-69aa-4489-aea9-95b5d0de3467 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029679 Nov 15 12:41:41.587352 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 151/305] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:41:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:41:41.589913 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-baafef24-2cd1-47b3-8c68-8e7ea752596a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 33831 microversion: 2.1 time: 2.412947 Nov 15 12:41:41.590678 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 155/306] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:41:39 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 33831 bytes in 2414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:41:41.592090 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-8f8aba3a-06a0-458e-9a53-d9f211a0a1bf tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:41.592815 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-8f8aba3a-06a0-458e-9a53-d9f211a0a1bf tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:41.599143 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8f8aba3a-06a0-458e-9a53-d9f211a0a1bf tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:41.599589 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8f8aba3a-06a0-458e-9a53-d9f211a0a1bf tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:41.600369 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8f8aba3a-06a0-458e-9a53-d9f211a0a1bf tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:41.600799 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8f8aba3a-06a0-458e-9a53-d9f211a0a1bf tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:41.816842 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-8f8aba3a-06a0-458e-9a53-d9f211a0a1bf tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:41.824224 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-8f8aba3a-06a0-458e-9a53-d9f211a0a1bf tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1521 microversion: 2.1 time: 0.235786 Nov 15 12:41:41.824878 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 152/307] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:41 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:42.567221 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-461231ae-1e45-4f63-8c77-bd6ebce30dde tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:42.568219 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-461231ae-1e45-4f63-8c77-bd6ebce30dde tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:42.575361 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-461231ae-1e45-4f63-8c77-bd6ebce30dde tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:42.575876 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-461231ae-1e45-4f63-8c77-bd6ebce30dde tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:42.576651 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-461231ae-1e45-4f63-8c77-bd6ebce30dde tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:42.577147 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-461231ae-1e45-4f63-8c77-bd6ebce30dde tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:42.603876 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-00729874-7abd-4ecb-99b2-9b6e4b0b1184 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:42.605090 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-00729874-7abd-4ecb-99b2-9b6e4b0b1184 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:42.613098 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-00729874-7abd-4ecb-99b2-9b6e4b0b1184 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:42.613772 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-00729874-7abd-4ecb-99b2-9b6e4b0b1184 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:42.615002 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-00729874-7abd-4ecb-99b2-9b6e4b0b1184 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:42.615391 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-00729874-7abd-4ecb-99b2-9b6e4b0b1184 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:42.691304 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-461231ae-1e45-4f63-8c77-bd6ebce30dde tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 14 microversion: 2.20 time: 0.127923 Nov 15 12:41:42.694606 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 156/308] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:41:42 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:42.735005 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-00729874-7abd-4ecb-99b2-9b6e4b0b1184 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 34571 microversion: 2.1 time: 0.135533 Nov 15 12:41:42.736586 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 153/309] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:41:42 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 34571 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:41:42.842750 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-a1d67098-c57f-4dce-9b7f-5b8e20f9c039 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:42.843501 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-a1d67098-c57f-4dce-9b7f-5b8e20f9c039 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:42.851738 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a1d67098-c57f-4dce-9b7f-5b8e20f9c039 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:42.852257 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a1d67098-c57f-4dce-9b7f-5b8e20f9c039 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:42.853123 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a1d67098-c57f-4dce-9b7f-5b8e20f9c039 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:42.853618 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a1d67098-c57f-4dce-9b7f-5b8e20f9c039 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:43.007123 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-a1d67098-c57f-4dce-9b7f-5b8e20f9c039 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:43.015340 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-a1d67098-c57f-4dce-9b7f-5b8e20f9c039 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1521 microversion: 2.1 time: 0.177173 Nov 15 12:41:43.015953 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 157/310] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:42 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:43.702854 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-9389b0ee-6f57-4c2b-a563-2c611c680532 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:43.703942 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-9389b0ee-6f57-4c2b-a563-2c611c680532 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:43.711061 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9389b0ee-6f57-4c2b-a563-2c611c680532 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:43.711617 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9389b0ee-6f57-4c2b-a563-2c611c680532 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:43.712477 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9389b0ee-6f57-4c2b-a563-2c611c680532 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:43.712975 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9389b0ee-6f57-4c2b-a563-2c611c680532 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:43.748253 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-d0e30c23-050f-4c2f-bcf4-871ec3a8b59a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:43.749162 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-d0e30c23-050f-4c2f-bcf4-871ec3a8b59a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:43.755828 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d0e30c23-050f-4c2f-bcf4-871ec3a8b59a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:43.756352 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d0e30c23-050f-4c2f-bcf4-871ec3a8b59a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:43.757319 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d0e30c23-050f-4c2f-bcf4-871ec3a8b59a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:43.757790 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d0e30c23-050f-4c2f-bcf4-871ec3a8b59a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:43.815452 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-9389b0ee-6f57-4c2b-a563-2c611c680532 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 14 microversion: 2.20 time: 0.117351 Nov 15 12:41:43.816509 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 154/311] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:41:43 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:43.915722 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-d0e30c23-050f-4c2f-bcf4-871ec3a8b59a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 35583 microversion: 2.1 time: 0.172066 Nov 15 12:41:43.916339 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 158/312] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:41:43 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 35583 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:41:44.034374 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-ce793846-dc83-4d3f-837e-e9556fd7de4e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:44.035100 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-ce793846-dc83-4d3f-837e-e9556fd7de4e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:44.042392 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ce793846-dc83-4d3f-837e-e9556fd7de4e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:44.042924 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ce793846-dc83-4d3f-837e-e9556fd7de4e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:44.043732 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ce793846-dc83-4d3f-837e-e9556fd7de4e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:44.044166 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ce793846-dc83-4d3f-837e-e9556fd7de4e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:44.190954 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-ce793846-dc83-4d3f-837e-e9556fd7de4e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:44.198322 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-ce793846-dc83-4d3f-837e-e9556fd7de4e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1521 microversion: 2.1 time: 0.169349 Nov 15 12:41:44.198913 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 155/313] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:44 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:44.827516 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-a8354ab6-996a-4427-a934-25bac4d4e981 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:44.828607 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-a8354ab6-996a-4427-a934-25bac4d4e981 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:44.835569 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a8354ab6-996a-4427-a934-25bac4d4e981 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:44.836021 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a8354ab6-996a-4427-a934-25bac4d4e981 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:44.836809 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a8354ab6-996a-4427-a934-25bac4d4e981 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:44.837242 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a8354ab6-996a-4427-a934-25bac4d4e981 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:44.929058 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-cb34a677-1993-47c4-8a4b-654039bd8f89 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:44.930029 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-cb34a677-1993-47c4-8a4b-654039bd8f89 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:44.937006 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-cb34a677-1993-47c4-8a4b-654039bd8f89 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:44.937447 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-cb34a677-1993-47c4-8a4b-654039bd8f89 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:44.938371 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-cb34a677-1993-47c4-8a4b-654039bd8f89 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:44.938891 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-cb34a677-1993-47c4-8a4b-654039bd8f89 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:44.969804 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-a8354ab6-996a-4427-a934-25bac4d4e981 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 14 microversion: 2.20 time: 0.146729 Nov 15 12:41:44.970357 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 159/314] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:41:44 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:45.078606 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-cb34a677-1993-47c4-8a4b-654039bd8f89 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 36448 microversion: 2.1 time: 0.153696 Nov 15 12:41:45.082744 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 156/315] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:41:44 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 36448 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:41:45.217818 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-58301db9-aa2c-46b9-b38d-ba18b298767e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:45.218666 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-58301db9-aa2c-46b9-b38d-ba18b298767e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:45.225830 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-58301db9-aa2c-46b9-b38d-ba18b298767e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:45.226664 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-58301db9-aa2c-46b9-b38d-ba18b298767e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:45.227465 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-58301db9-aa2c-46b9-b38d-ba18b298767e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:45.227889 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-58301db9-aa2c-46b9-b38d-ba18b298767e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:45.377760 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-58301db9-aa2c-46b9-b38d-ba18b298767e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:45.391786 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-58301db9-aa2c-46b9-b38d-ba18b298767e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1521 microversion: 2.1 time: 0.179045 Nov 15 12:41:45.392391 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 160/316] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:45 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:45.982035 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-6c1d4520-da62-44a4-a41c-bfafcd9b40d0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:45.983675 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-6c1d4520-da62-44a4-a41c-bfafcd9b40d0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:45.992236 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6c1d4520-da62-44a4-a41c-bfafcd9b40d0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:45.993406 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6c1d4520-da62-44a4-a41c-bfafcd9b40d0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:45.993521 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6c1d4520-da62-44a4-a41c-bfafcd9b40d0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:45.993844 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6c1d4520-da62-44a4-a41c-bfafcd9b40d0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:46.087876 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-6c1d4520-da62-44a4-a41c-bfafcd9b40d0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 14 microversion: 2.20 time: 0.110449 Nov 15 12:41:46.088793 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 157/317] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:41:45 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:46.090997 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-bdaa2756-6e30-4207-b302-cab3a0cde83c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:46.093385 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-bdaa2756-6e30-4207-b302-cab3a0cde83c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:46.100367 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bdaa2756-6e30-4207-b302-cab3a0cde83c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:46.100812 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bdaa2756-6e30-4207-b302-cab3a0cde83c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:46.101605 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bdaa2756-6e30-4207-b302-cab3a0cde83c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:46.102038 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bdaa2756-6e30-4207-b302-cab3a0cde83c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:46.223432 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-bdaa2756-6e30-4207-b302-cab3a0cde83c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 37553 microversion: 2.1 time: 0.136556 Nov 15 12:41:46.224090 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 161/318] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:41:46 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 37553 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:41:46.409566 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-dd8b66f0-5d04-4e49-b73d-07c7b5278c58 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:46.410252 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-dd8b66f0-5d04-4e49-b73d-07c7b5278c58 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:46.417085 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-dd8b66f0-5d04-4e49-b73d-07c7b5278c58 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:46.417533 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-dd8b66f0-5d04-4e49-b73d-07c7b5278c58 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:46.418305 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-dd8b66f0-5d04-4e49-b73d-07c7b5278c58 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:46.418731 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-dd8b66f0-5d04-4e49-b73d-07c7b5278c58 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:46.553955 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-dd8b66f0-5d04-4e49-b73d-07c7b5278c58 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:46.561294 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-dd8b66f0-5d04-4e49-b73d-07c7b5278c58 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1521 microversion: 2.1 time: 0.155842 Nov 15 12:41:46.561845 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 158/319] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:46 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:47.100002 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e3a5a175-41f7-4a9f-a163-129cb1ccd4be tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:47.101443 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e3a5a175-41f7-4a9f-a163-129cb1ccd4be tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:47.108850 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e3a5a175-41f7-4a9f-a163-129cb1ccd4be tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:47.109517 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e3a5a175-41f7-4a9f-a163-129cb1ccd4be tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:47.110348 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e3a5a175-41f7-4a9f-a163-129cb1ccd4be tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:47.110882 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e3a5a175-41f7-4a9f-a163-129cb1ccd4be tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:47.206480 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e3a5a175-41f7-4a9f-a163-129cb1ccd4be tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 14 microversion: 2.20 time: 0.110721 Nov 15 12:41:47.207253 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 162/320] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:41:47 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:47.236404 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-b0d95410-ecd8-4d59-a1dc-c8e5079d32cc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:47.237529 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-b0d95410-ecd8-4d59-a1dc-c8e5079d32cc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:47.243850 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b0d95410-ecd8-4d59-a1dc-c8e5079d32cc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:47.244461 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b0d95410-ecd8-4d59-a1dc-c8e5079d32cc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:47.245456 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b0d95410-ecd8-4d59-a1dc-c8e5079d32cc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:47.245906 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b0d95410-ecd8-4d59-a1dc-c8e5079d32cc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:47.357657 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-b0d95410-ecd8-4d59-a1dc-c8e5079d32cc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 38136 microversion: 2.1 time: 0.124791 Nov 15 12:41:47.358178 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 159/321] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:41:47 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 38136 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:41:47.409770 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-43aa4825-b442-457a-a945-a39d5964fef7 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1143456497", "imageRef": "3cc21e2c-27da-4266-be76-369023341c16", "flavorRef": "452", "networks": [{"uuid": "b79f49ef-73b5-4352-9d73-84333759f64b"}]}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:47.469370 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.network.neutron [None req-43aa4825-b442-457a-a945-a39d5964fef7 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] validate_networks() for [('b79f49ef-73b5-4352-9d73-84333759f64b', None, None, None, None, None)] {{(pid=122567) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 15 12:41:47.578928 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-9c418fa2-d989-42d8-9a44-257a62f9ce5a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:47.579417 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-9c418fa2-d989-42d8-9a44-257a62f9ce5a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:47.587004 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9c418fa2-d989-42d8-9a44-257a62f9ce5a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:47.587527 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9c418fa2-d989-42d8-9a44-257a62f9ce5a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:47.588396 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9c418fa2-d989-42d8-9a44-257a62f9ce5a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:47.588899 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9c418fa2-d989-42d8-9a44-257a62f9ce5a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:47.857428 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-9c418fa2-d989-42d8-9a44-257a62f9ce5a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:47.865749 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-9c418fa2-d989-42d8-9a44-257a62f9ce5a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1521 microversion: 2.1 time: 0.291932 Nov 15 12:41:47.866320 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 160/322] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:47 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:41:47.897965 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-43aa4825-b442-457a-a945-a39d5964fef7 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Flavor limits 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 15 12:41:47.898530 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-43aa4825-b442-457a-a945-a39d5964fef7 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Image limits 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 15 12:41:47.899163 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-43aa4825-b442-457a-a945-a39d5964fef7 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Flavor pref 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 15 12:41:47.899787 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-43aa4825-b442-457a-a945-a39d5964fef7 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Image pref 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 15 12:41:47.900377 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-43aa4825-b442-457a-a945-a39d5964fef7 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 15 12:41:47.910966 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-43aa4825-b442-457a-a945-a39d5964fef7 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:47.911496 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-43aa4825-b442-457a-a945-a39d5964fef7 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:47.912360 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-43aa4825-b442-457a-a945-a39d5964fef7 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:47.912858 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-43aa4825-b442-457a-a945-a39d5964fef7 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:47.933743 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.quota [None req-43aa4825-b442-457a-a945-a39d5964fef7 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Getting quotas for project 3aae5c632c8b4d4f94206b1d6745c0ba. Resources: {'cores', 'ram', 'instances'} {{(pid=122567) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:41:47.937885 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.quota [None req-43aa4825-b442-457a-a945-a39d5964fef7 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Getting quotas for user a44c99bd2e434807b12facc77f18a5cf and project 3aae5c632c8b4d4f94206b1d6745c0ba. Resources: {'cores', 'ram', 'instances'} {{(pid=122567) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:41:47.948773 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-43aa4825-b442-457a-a945-a39d5964fef7 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Going to run 1 instances... {{(pid=122567) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 15 12:41:47.951448 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-43aa4825-b442-457a-a945-a39d5964fef7 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: d7de1403-72dd-46fd-b7a0-97e4d6c201d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3cc21e2c-27da-4266-be76-369023341c16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 15 12:41:48.002001 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-43aa4825-b442-457a-a945-a39d5964fef7 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.596762 Nov 15 12:41:48.002823 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 163/323] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Nov 15 12:41:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 15 12:41:48.012293 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-e5dc8a7c-ecac-44da-9f32-366967dc596d tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:48.012941 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-e5dc8a7c-ecac-44da-9f32-366967dc596d tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: d7de1403-72dd-46fd-b7a0-97e4d6c201d9] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:48.087401 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-e5dc8a7c-ecac-44da-9f32-366967dc596d tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44c99bd2e434807b12facc77f18a5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aae5c632c8b4d4f94206b1d6745c0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:48.095075 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-e5dc8a7c-ecac-44da-9f32-366967dc596d tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "GET /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9" status: 200 len: 1219 microversion: 2.1 time: 0.086398 Nov 15 12:41:48.095831 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 161/324] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:48 2021] GET /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:48.226435 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e242bbdf-c7a2-4562-a1ef-2498c56e16da tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:48.228039 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e242bbdf-c7a2-4562-a1ef-2498c56e16da tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:48.239820 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e242bbdf-c7a2-4562-a1ef-2498c56e16da tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:48.241305 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e242bbdf-c7a2-4562-a1ef-2498c56e16da tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:48.242350 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e242bbdf-c7a2-4562-a1ef-2498c56e16da tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:48.243109 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e242bbdf-c7a2-4562-a1ef-2498c56e16da tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:48.343720 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e242bbdf-c7a2-4562-a1ef-2498c56e16da tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 14 microversion: 2.20 time: 0.129723 Nov 15 12:41:48.344617 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 164/325] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:41:48 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:41:48.369663 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-3bab12d9-f104-45e2-8807-8a5231aa365a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:48.370662 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-3bab12d9-f104-45e2-8807-8a5231aa365a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:48.378681 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3bab12d9-f104-45e2-8807-8a5231aa365a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:48.379474 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3bab12d9-f104-45e2-8807-8a5231aa365a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:48.380260 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3bab12d9-f104-45e2-8807-8a5231aa365a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:48.380705 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3bab12d9-f104-45e2-8807-8a5231aa365a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:48.501221 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-3bab12d9-f104-45e2-8807-8a5231aa365a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 38136 microversion: 2.1 time: 0.135224 Nov 15 12:41:48.501886 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 162/326] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:41:48 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 38136 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:41:48.884279 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-0759dba7-da3a-4b04-9d2f-019791b1b00d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:48.884888 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-0759dba7-da3a-4b04-9d2f-019791b1b00d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:48.892394 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0759dba7-da3a-4b04-9d2f-019791b1b00d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:48.892843 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0759dba7-da3a-4b04-9d2f-019791b1b00d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:48.893613 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0759dba7-da3a-4b04-9d2f-019791b1b00d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:48.894040 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0759dba7-da3a-4b04-9d2f-019791b1b00d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:49.033442 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-0759dba7-da3a-4b04-9d2f-019791b1b00d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:49.040727 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-0759dba7-da3a-4b04-9d2f-019791b1b00d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1521 microversion: 2.1 time: 0.160534 Nov 15 12:41:49.041305 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 165/327] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:48 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:49.113142 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-d202ea99-f13f-4a56-a412-f9c7d8babf4c tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:49.113982 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-d202ea99-f13f-4a56-a412-f9c7d8babf4c tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: d7de1403-72dd-46fd-b7a0-97e4d6c201d9] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:49.121442 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d202ea99-f13f-4a56-a412-f9c7d8babf4c tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:49.121882 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d202ea99-f13f-4a56-a412-f9c7d8babf4c tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:49.123492 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d202ea99-f13f-4a56-a412-f9c7d8babf4c tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:49.124051 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d202ea99-f13f-4a56-a412-f9c7d8babf4c tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:49.190216 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-d202ea99-f13f-4a56-a412-f9c7d8babf4c tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44c99bd2e434807b12facc77f18a5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aae5c632c8b4d4f94206b1d6745c0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:49.197854 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-d202ea99-f13f-4a56-a412-f9c7d8babf4c tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "GET /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9" status: 200 len: 1271 microversion: 2.1 time: 0.088725 Nov 15 12:41:49.198409 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 163/328] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:49 2021] GET /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9 => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:41:49.355870 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-a14ec560-7c02-478f-b934-3938deacaad0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:49.357717 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-a14ec560-7c02-478f-b934-3938deacaad0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:49.364567 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a14ec560-7c02-478f-b934-3938deacaad0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:49.365031 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a14ec560-7c02-478f-b934-3938deacaad0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:49.365828 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a14ec560-7c02-478f-b934-3938deacaad0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:49.366327 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a14ec560-7c02-478f-b934-3938deacaad0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:49.516543 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-5d82e33d-e4c4-4889-9f1a-5d032b8aeb3f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:49.517577 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-5d82e33d-e4c4-4889-9f1a-5d032b8aeb3f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:49.522379 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-a14ec560-7c02-478f-b934-3938deacaad0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 14 microversion: 2.20 time: 0.170166 Nov 15 12:41:49.523430 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 166/329] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:41:49 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 14 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:49.526746 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5d82e33d-e4c4-4889-9f1a-5d032b8aeb3f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:49.527326 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5d82e33d-e4c4-4889-9f1a-5d032b8aeb3f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:49.528201 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5d82e33d-e4c4-4889-9f1a-5d032b8aeb3f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:49.529210 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5d82e33d-e4c4-4889-9f1a-5d032b8aeb3f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:49.663327 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-5d82e33d-e4c4-4889-9f1a-5d032b8aeb3f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 200 len: 38267 microversion: 2.1 time: 0.152578 Nov 15 12:41:49.664802 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 164/330] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:41:49 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 38267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:41:49.675074 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-17067f12-cdbf-4d96-b40a-7c2e63bf6c93 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:49.675646 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-17067f12-cdbf-4d96-b40a-7c2e63bf6c93 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:49.687147 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-17067f12-cdbf-4d96-b40a-7c2e63bf6c93 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:49.687611 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-17067f12-cdbf-4d96-b40a-7c2e63bf6c93 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:49.688426 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-17067f12-cdbf-4d96-b40a-7c2e63bf6c93 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:49.688863 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-17067f12-cdbf-4d96-b40a-7c2e63bf6c93 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:49.723652 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-17067f12-cdbf-4d96-b40a-7c2e63bf6c93 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/ips" status: 200 len: 145 microversion: 2.1 time: 0.052990 Nov 15 12:41:49.724666 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 167/331] 10.222.0.43 () {58 vars in 1247 bytes} [Mon Nov 15 12:41:49 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/ips => generated 145 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 15 12:41:50.059621 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-edd076a3-40dc-4e5e-bcdc-cfa0d9d2f7aa tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:50.060536 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-edd076a3-40dc-4e5e-bcdc-cfa0d9d2f7aa tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:50.067965 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-edd076a3-40dc-4e5e-bcdc-cfa0d9d2f7aa tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:50.068498 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-edd076a3-40dc-4e5e-bcdc-cfa0d9d2f7aa tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:50.069307 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-edd076a3-40dc-4e5e-bcdc-cfa0d9d2f7aa tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:50.070144 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-edd076a3-40dc-4e5e-bcdc-cfa0d9d2f7aa tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:50.216242 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-9cb0f71b-b953-4ba7-aecd-c1300d0075ab tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:50.218084 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-9cb0f71b-b953-4ba7-aecd-c1300d0075ab tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: d7de1403-72dd-46fd-b7a0-97e4d6c201d9] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:50.224228 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9cb0f71b-b953-4ba7-aecd-c1300d0075ab tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:50.224695 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9cb0f71b-b953-4ba7-aecd-c1300d0075ab tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:50.225531 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9cb0f71b-b953-4ba7-aecd-c1300d0075ab tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:50.225968 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9cb0f71b-b953-4ba7-aecd-c1300d0075ab tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:50.354226 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-edd076a3-40dc-4e5e-bcdc-cfa0d9d2f7aa tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:50.361849 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-edd076a3-40dc-4e5e-bcdc-cfa0d9d2f7aa tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1521 microversion: 2.1 time: 0.306700 Nov 15 12:41:50.362432 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 165/332] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:50 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:50.415518 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-9cb0f71b-b953-4ba7-aecd-c1300d0075ab tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44c99bd2e434807b12facc77f18a5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aae5c632c8b4d4f94206b1d6745c0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:50.423733 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-9cb0f71b-b953-4ba7-aecd-c1300d0075ab tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "GET /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9" status: 200 len: 1319 microversion: 2.1 time: 0.211722 Nov 15 12:41:50.424240 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 168/333] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:50 2021] GET /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:41:50.537354 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-7ae65eb0-c4f8-422c-8e45-cc0cb113b864 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:50.538278 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-7ae65eb0-c4f8-422c-8e45-cc0cb113b864 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:50.544044 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7ae65eb0-c4f8-422c-8e45-cc0cb113b864 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:50.544506 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7ae65eb0-c4f8-422c-8e45-cc0cb113b864 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:50.545285 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7ae65eb0-c4f8-422c-8e45-cc0cb113b864 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:50.545703 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7ae65eb0-c4f8-422c-8e45-cc0cb113b864 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:50.633033 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-7ae65eb0-c4f8-422c-8e45-cc0cb113b864 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 14 microversion: 2.20 time: 0.099315 Nov 15 12:41:50.633576 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 166/334] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:41:50 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:51.115990 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [req-5f56b34d-89d7-4d47-a1c7-a42dbfa6d351 req-7385bade-4e17-45d6-a62b-30209879e8a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7de1403-72dd-46fd-b7a0-97e4d6c201d9", "tag": "7ce2ec7c-8faf-4005-8f1a-e50c4a7a1c29"}]} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:51.117505 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:41:51.117505 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: warnings.warn(msg) Nov 15 12:41:51.130297 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-5f56b34d-89d7-4d47-a1c7-a42dbfa6d351 req-7385bade-4e17-45d6-a62b-30209879e8a3 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:51.131966 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-5f56b34d-89d7-4d47-a1c7-a42dbfa6d351 req-7385bade-4e17-45d6-a62b-30209879e8a3 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:51.155384 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.compute.server_external_events [req-5f56b34d-89d7-4d47-a1c7-a42dbfa6d351 req-7385bade-4e17-45d6-a62b-30209879e8a3 service nova] Creating event network-changed:7ce2ec7c-8faf-4005-8f1a-e50c4a7a1c29 for instance d7de1403-72dd-46fd-b7a0-97e4d6c201d9 on hv-cinder-68088 Nov 15 12:41:51.160839 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [req-5f56b34d-89d7-4d47-a1c7-a42dbfa6d351 req-7385bade-4e17-45d6-a62b-30209879e8a3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048244 Nov 15 12:41:51.173276 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 169/335] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:41:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:41:51.381360 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-d2368f07-530b-43e3-8663-76c2c722b108 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:51.382385 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-d2368f07-530b-43e3-8663-76c2c722b108 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:51.391605 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d2368f07-530b-43e3-8663-76c2c722b108 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:51.392057 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d2368f07-530b-43e3-8663-76c2c722b108 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:51.392922 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d2368f07-530b-43e3-8663-76c2c722b108 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:51.393450 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d2368f07-530b-43e3-8663-76c2c722b108 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:51.441759 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-35c9d1b7-e65b-4aa3-b873-dd04f43e9be0 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:51.442448 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-35c9d1b7-e65b-4aa3-b873-dd04f43e9be0 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: d7de1403-72dd-46fd-b7a0-97e4d6c201d9] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:51.454999 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-35c9d1b7-e65b-4aa3-b873-dd04f43e9be0 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:51.455925 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-35c9d1b7-e65b-4aa3-b873-dd04f43e9be0 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:51.456949 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-35c9d1b7-e65b-4aa3-b873-dd04f43e9be0 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:51.457397 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-35c9d1b7-e65b-4aa3-b873-dd04f43e9be0 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:51.757171 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-d2368f07-530b-43e3-8663-76c2c722b108 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:51.766591 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-d2368f07-530b-43e3-8663-76c2c722b108 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1521 microversion: 2.1 time: 0.389873 Nov 15 12:41:51.767416 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 167/336] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:51 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:51.777298 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-2f660fea-671c-41ad-9292-f37f095a8f39 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:51.778686 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-2f660fea-671c-41ad-9292-f37f095a8f39 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:51.786527 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2f660fea-671c-41ad-9292-f37f095a8f39 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:51.787070 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2f660fea-671c-41ad-9292-f37f095a8f39 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:51.788053 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2f660fea-671c-41ad-9292-f37f095a8f39 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:51.788653 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2f660fea-671c-41ad-9292-f37f095a8f39 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:51.828642 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-35c9d1b7-e65b-4aa3-b873-dd04f43e9be0 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44c99bd2e434807b12facc77f18a5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aae5c632c8b4d4f94206b1d6745c0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:51.834803 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-35c9d1b7-e65b-4aa3-b873-dd04f43e9be0 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "GET /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9" status: 200 len: 1319 microversion: 2.1 time: 0.397376 Nov 15 12:41:51.835568 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 170/337] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:51 2021] GET /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9 => generated 1319 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:41:51.904313 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-2f660fea-671c-41ad-9292-f37f095a8f39 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 14 microversion: 2.20 time: 0.134424 Nov 15 12:41:51.905719 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 168/338] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:41:51 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:52.315148 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-2f8c6d9d-a063-481d-adbc-58b039711c55 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00fa0349-ce92-452d-bb24-21ae4ced5d0d"}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:52.316210 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-2f8c6d9d-a063-481d-adbc-58b039711c55 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:52.323233 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2f8c6d9d-a063-481d-adbc-58b039711c55 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:52.323684 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2f8c6d9d-a063-481d-adbc-58b039711c55 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:52.324482 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2f8c6d9d-a063-481d-adbc-58b039711c55 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:52.324907 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2f8c6d9d-a063-481d-adbc-58b039711c55 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:52.641440 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-2f8c6d9d-a063-481d-adbc-58b039711c55 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.330147 Nov 15 12:41:52.642476 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 171/339] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Nov 15 12:41:52 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/os-volume_attachments => generated 194 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:41:52.785200 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-f9d29828-bb19-4283-8cbf-b328a745b368 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:52.785937 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-f9d29828-bb19-4283-8cbf-b328a745b368 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:52.792633 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f9d29828-bb19-4283-8cbf-b328a745b368 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:52.793086 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f9d29828-bb19-4283-8cbf-b328a745b368 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:52.793860 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f9d29828-bb19-4283-8cbf-b328a745b368 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:52.794372 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f9d29828-bb19-4283-8cbf-b328a745b368 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:52.853052 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-609fee24-70d0-47be-8875-f1a87f9625fe tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:52.854002 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-609fee24-70d0-47be-8875-f1a87f9625fe tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: d7de1403-72dd-46fd-b7a0-97e4d6c201d9] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:52.862085 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-609fee24-70d0-47be-8875-f1a87f9625fe tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:52.862993 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-609fee24-70d0-47be-8875-f1a87f9625fe tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:52.865030 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-609fee24-70d0-47be-8875-f1a87f9625fe tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:52.865719 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-609fee24-70d0-47be-8875-f1a87f9625fe tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:53.111432 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-f9d29828-bb19-4283-8cbf-b328a745b368 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:53.119100 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-f9d29828-bb19-4283-8cbf-b328a745b368 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1501 microversion: 2.1 time: 0.338061 Nov 15 12:41:53.119687 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 169/340] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:52 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1501 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:53.131134 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-64d8dd60-ed56-4796-9bc5-4849a80ea895 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:53.132105 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-64d8dd60-ed56-4796-9bc5-4849a80ea895 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:53.139920 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-64d8dd60-ed56-4796-9bc5-4849a80ea895 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:53.140366 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-64d8dd60-ed56-4796-9bc5-4849a80ea895 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:53.141200 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-64d8dd60-ed56-4796-9bc5-4849a80ea895 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:53.141591 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-64d8dd60-ed56-4796-9bc5-4849a80ea895 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:53.151340 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-609fee24-70d0-47be-8875-f1a87f9625fe tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44c99bd2e434807b12facc77f18a5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aae5c632c8b4d4f94206b1d6745c0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:53.161770 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-609fee24-70d0-47be-8875-f1a87f9625fe tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "GET /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9" status: 200 len: 1319 microversion: 2.1 time: 0.312619 Nov 15 12:41:53.162709 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 172/341] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:52 2021] GET /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9 => generated 1319 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:41:53.168703 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-5e1b90e3-3617-49b5-9020-06f0e9313140 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f6bbfae-1a42-4ed4-b222-21d0b8da527e"}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:53.170029 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-5e1b90e3-3617-49b5-9020-06f0e9313140 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:53.176232 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5e1b90e3-3617-49b5-9020-06f0e9313140 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:53.176843 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5e1b90e3-3617-49b5-9020-06f0e9313140 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:53.177762 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5e1b90e3-3617-49b5-9020-06f0e9313140 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:53.178425 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5e1b90e3-3617-49b5-9020-06f0e9313140 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:53.209492 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.wsgi [None req-5e1b90e3-3617-49b5-9020-06f0e9313140 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] HTTP exception thrown: Cannot 'attach_volume' instance aea00c4f-da8f-4b9e-8c12-7ebe91776986 while it is in vm_state rescued Nov 15 12:41:53.210168 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-5e1b90e3-3617-49b5-9020-06f0e9313140 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Returning 409 to user: Cannot 'attach_volume' instance aea00c4f-da8f-4b9e-8c12-7ebe91776986 while it is in vm_state rescued {{(pid=122567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:41:53.211166 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-5e1b90e3-3617-49b5-9020-06f0e9313140 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "POST /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047331 Nov 15 12:41:53.211884 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 173/342] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Nov 15 12:41:53 2021] POST /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986/os-volume_attachments => generated 152 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 15 12:41:53.221148 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-08802cb6-d139-4739-b262-8cc92828c6d6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:53.221735 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-08802cb6-d139-4739-b262-8cc92828c6d6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:53.228471 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-08802cb6-d139-4739-b262-8cc92828c6d6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:53.228885 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-08802cb6-d139-4739-b262-8cc92828c6d6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:53.229917 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-08802cb6-d139-4739-b262-8cc92828c6d6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:53.230350 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-08802cb6-d139-4739-b262-8cc92828c6d6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:53.251982 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-64d8dd60-ed56-4796-9bc5-4849a80ea895 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 14 microversion: 2.20 time: 0.131036 Nov 15 12:41:53.252793 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 170/343] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:41:53 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:53.483633 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-08802cb6-d139-4739-b262-8cc92828c6d6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "POST /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986/action" status: 202 len: 0 microversion: 2.1 time: 0.264806 Nov 15 12:41:53.484449 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 174/344] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:41:53 2021] POST /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:41:53.493557 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-0c1390bd-880d-4daa-87e8-0930693d3f57 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:53.494498 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-0c1390bd-880d-4daa-87e8-0930693d3f57 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:53.503335 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0c1390bd-880d-4daa-87e8-0930693d3f57 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:53.504059 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0c1390bd-880d-4daa-87e8-0930693d3f57 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:53.505061 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0c1390bd-880d-4daa-87e8-0930693d3f57 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:53.505788 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0c1390bd-880d-4daa-87e8-0930693d3f57 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:53.821036 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-0c1390bd-880d-4daa-87e8-0930693d3f57 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:53.830848 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-0c1390bd-880d-4daa-87e8-0930693d3f57 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1509 microversion: 2.1 time: 0.342028 Nov 15 12:41:53.831680 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 171/345] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:53 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1509 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:54.190023 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-6b7b1c79-fa53-4eb0-b768-bc147249fc94 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:54.191611 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-6b7b1c79-fa53-4eb0-b768-bc147249fc94 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: d7de1403-72dd-46fd-b7a0-97e4d6c201d9] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:54.220965 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6b7b1c79-fa53-4eb0-b768-bc147249fc94 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:54.221566 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6b7b1c79-fa53-4eb0-b768-bc147249fc94 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:54.224540 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6b7b1c79-fa53-4eb0-b768-bc147249fc94 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:54.226642 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6b7b1c79-fa53-4eb0-b768-bc147249fc94 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:54.271926 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-1d6b1b09-3d0d-4b0c-85af-c56a65a30606 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:54.277896 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-1d6b1b09-3d0d-4b0c-85af-c56a65a30606 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:54.291192 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1d6b1b09-3d0d-4b0c-85af-c56a65a30606 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:54.293770 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1d6b1b09-3d0d-4b0c-85af-c56a65a30606 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:54.295975 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1d6b1b09-3d0d-4b0c-85af-c56a65a30606 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:54.296426 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1d6b1b09-3d0d-4b0c-85af-c56a65a30606 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:54.397164 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-6b7b1c79-fa53-4eb0-b768-bc147249fc94 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44c99bd2e434807b12facc77f18a5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aae5c632c8b4d4f94206b1d6745c0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:54.400359 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-1d6b1b09-3d0d-4b0c-85af-c56a65a30606 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 1799 microversion: 2.20 time: 0.137429 Nov 15 12:41:54.401600 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 172/346] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:41:54 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 1799 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:41:54.409149 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-6b7b1c79-fa53-4eb0-b768-bc147249fc94 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "GET /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9" status: 200 len: 1319 microversion: 2.1 time: 0.233529 Nov 15 12:41:54.411483 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 175/347] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:54 2021] GET /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:54.849774 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-b327a92a-f51f-4a88-ba1b-1311ade138e7 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:54.850474 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-b327a92a-f51f-4a88-ba1b-1311ade138e7 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:54.858098 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b327a92a-f51f-4a88-ba1b-1311ade138e7 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:54.858412 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b327a92a-f51f-4a88-ba1b-1311ade138e7 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:54.859433 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b327a92a-f51f-4a88-ba1b-1311ade138e7 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:54.860036 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b327a92a-f51f-4a88-ba1b-1311ade138e7 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:55.024129 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-b327a92a-f51f-4a88-ba1b-1311ade138e7 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:55.033392 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-b327a92a-f51f-4a88-ba1b-1311ade138e7 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1509 microversion: 2.1 time: 0.187639 Nov 15 12:41:55.034592 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 173/348] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:54 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1509 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:55.414242 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-65cd9cfc-5c92-4b8e-8fd4-6b22175a2c33 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:55.416551 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-65cd9cfc-5c92-4b8e-8fd4-6b22175a2c33 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:55.427380 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-65cd9cfc-5c92-4b8e-8fd4-6b22175a2c33 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:55.428176 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-65cd9cfc-5c92-4b8e-8fd4-6b22175a2c33 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:55.428341 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-b8f085b2-47f3-4ffd-9ab5-312332cee8f8 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:55.429123 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-b8f085b2-47f3-4ffd-9ab5-312332cee8f8 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: d7de1403-72dd-46fd-b7a0-97e4d6c201d9] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:55.429474 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-65cd9cfc-5c92-4b8e-8fd4-6b22175a2c33 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:55.430106 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-65cd9cfc-5c92-4b8e-8fd4-6b22175a2c33 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:55.440786 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b8f085b2-47f3-4ffd-9ab5-312332cee8f8 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:55.441223 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b8f085b2-47f3-4ffd-9ab5-312332cee8f8 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:55.442200 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b8f085b2-47f3-4ffd-9ab5-312332cee8f8 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:55.442761 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b8f085b2-47f3-4ffd-9ab5-312332cee8f8 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:55.546126 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-65cd9cfc-5c92-4b8e-8fd4-6b22175a2c33 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 10159 microversion: 2.20 time: 0.137489 Nov 15 12:41:55.548600 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 176/349] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:41:55 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 10159 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:41:55.937434 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-b8f085b2-47f3-4ffd-9ab5-312332cee8f8 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44c99bd2e434807b12facc77f18a5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aae5c632c8b4d4f94206b1d6745c0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:55.950261 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-b8f085b2-47f3-4ffd-9ab5-312332cee8f8 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "GET /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9" status: 200 len: 1319 microversion: 2.1 time: 0.525794 Nov 15 12:41:55.953110 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 174/350] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:55 2021] GET /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9 => generated 1319 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:41:56.053901 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-60bf1ad9-a146-4d7a-80a4-25f51d575f80 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:56.057101 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-60bf1ad9-a146-4d7a-80a4-25f51d575f80 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:56.081541 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-60bf1ad9-a146-4d7a-80a4-25f51d575f80 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:56.083086 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-60bf1ad9-a146-4d7a-80a4-25f51d575f80 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:56.084155 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-60bf1ad9-a146-4d7a-80a4-25f51d575f80 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:56.084665 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-60bf1ad9-a146-4d7a-80a4-25f51d575f80 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:56.348922 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-60bf1ad9-a146-4d7a-80a4-25f51d575f80 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:56.356666 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-60bf1ad9-a146-4d7a-80a4-25f51d575f80 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1509 microversion: 2.1 time: 0.307977 Nov 15 12:41:56.357244 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 177/351] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:56 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1509 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:56.558885 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-bb8695be-1982-429f-8d42-17816c9574b3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:56.561568 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-bb8695be-1982-429f-8d42-17816c9574b3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:56.568898 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bb8695be-1982-429f-8d42-17816c9574b3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:56.570197 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bb8695be-1982-429f-8d42-17816c9574b3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:56.571302 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bb8695be-1982-429f-8d42-17816c9574b3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:56.571927 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bb8695be-1982-429f-8d42-17816c9574b3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:56.696894 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-bb8695be-1982-429f-8d42-17816c9574b3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 15025 microversion: 2.20 time: 0.141569 Nov 15 12:41:56.698070 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 175/352] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:41:56 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 15025 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:41:56.972677 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-93c37fb7-25b7-4252-a7d8-f09ca6949824 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:56.974074 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-93c37fb7-25b7-4252-a7d8-f09ca6949824 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: d7de1403-72dd-46fd-b7a0-97e4d6c201d9] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:56.993916 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-93c37fb7-25b7-4252-a7d8-f09ca6949824 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:56.994378 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-93c37fb7-25b7-4252-a7d8-f09ca6949824 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:56.995204 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-93c37fb7-25b7-4252-a7d8-f09ca6949824 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:56.995635 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-93c37fb7-25b7-4252-a7d8-f09ca6949824 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:57.239049 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-93c37fb7-25b7-4252-a7d8-f09ca6949824 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44c99bd2e434807b12facc77f18a5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aae5c632c8b4d4f94206b1d6745c0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:57.260302 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-93c37fb7-25b7-4252-a7d8-f09ca6949824 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "GET /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9" status: 200 len: 1319 microversion: 2.1 time: 0.295031 Nov 15 12:41:57.266024 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 178/353] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:56 2021] GET /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9 => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:57.379326 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-6fac90be-0dd2-4ad0-a29f-f16124eac673 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:57.380811 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-6fac90be-0dd2-4ad0-a29f-f16124eac673 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:57.404786 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6fac90be-0dd2-4ad0-a29f-f16124eac673 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:57.405501 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6fac90be-0dd2-4ad0-a29f-f16124eac673 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:57.406400 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6fac90be-0dd2-4ad0-a29f-f16124eac673 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:57.407003 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6fac90be-0dd2-4ad0-a29f-f16124eac673 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:57.636992 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-6fac90be-0dd2-4ad0-a29f-f16124eac673 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:57.657775 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-6fac90be-0dd2-4ad0-a29f-f16124eac673 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1515 microversion: 2.1 time: 0.287674 Nov 15 12:41:57.658963 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 176/354] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:57 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1515 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:41:57.709406 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-ae31a8d0-674c-4220-b434-0033090a7eb1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:57.710528 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-ae31a8d0-674c-4220-b434-0033090a7eb1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:57.723320 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ae31a8d0-674c-4220-b434-0033090a7eb1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:57.723860 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ae31a8d0-674c-4220-b434-0033090a7eb1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:57.725993 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ae31a8d0-674c-4220-b434-0033090a7eb1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:57.727417 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ae31a8d0-674c-4220-b434-0033090a7eb1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:57.843213 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-ae31a8d0-674c-4220-b434-0033090a7eb1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 18056 microversion: 2.20 time: 0.137319 Nov 15 12:41:57.844282 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 179/355] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:41:57 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 18056 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:41:57.981090 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-19c88cd8-0b58-44cb-97b4-d9f21bb5d5b8 req-6381d9b3-9cce-44e5-938f-aa66bbf7d98c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7de1403-72dd-46fd-b7a0-97e4d6c201d9", "name": "network-vif-plugged", "status": "completed", "tag": "7ce2ec7c-8faf-4005-8f1a-e50c4a7a1c29"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:57.983257 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:41:57.983257 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:41:57.999210 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-19c88cd8-0b58-44cb-97b4-d9f21bb5d5b8 req-6381d9b3-9cce-44e5-938f-aa66bbf7d98c service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:57.999857 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-19c88cd8-0b58-44cb-97b4-d9f21bb5d5b8 req-6381d9b3-9cce-44e5-938f-aa66bbf7d98c service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:58.022291 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-19c88cd8-0b58-44cb-97b4-d9f21bb5d5b8 req-6381d9b3-9cce-44e5-938f-aa66bbf7d98c service nova] Creating event network-vif-plugged:7ce2ec7c-8faf-4005-8f1a-e50c4a7a1c29 for instance d7de1403-72dd-46fd-b7a0-97e4d6c201d9 on hv-cinder-68088 Nov 15 12:41:58.037817 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-19c88cd8-0b58-44cb-97b4-d9f21bb5d5b8 req-6381d9b3-9cce-44e5-938f-aa66bbf7d98c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060407 Nov 15 12:41:58.039685 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 177/356] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:41:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:41:58.282038 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-75c0450d-a177-4993-b75a-c5a1e48c5284 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:58.282760 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-75c0450d-a177-4993-b75a-c5a1e48c5284 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: d7de1403-72dd-46fd-b7a0-97e4d6c201d9] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:58.293746 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-75c0450d-a177-4993-b75a-c5a1e48c5284 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:58.294935 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-75c0450d-a177-4993-b75a-c5a1e48c5284 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:58.295735 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-75c0450d-a177-4993-b75a-c5a1e48c5284 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:58.296355 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-75c0450d-a177-4993-b75a-c5a1e48c5284 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:58.470274 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-75c0450d-a177-4993-b75a-c5a1e48c5284 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44c99bd2e434807b12facc77f18a5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aae5c632c8b4d4f94206b1d6745c0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:58.478971 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-75c0450d-a177-4993-b75a-c5a1e48c5284 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "GET /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9" status: 200 len: 1319 microversion: 2.1 time: 0.201165 Nov 15 12:41:58.479781 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 180/357] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:58 2021] GET /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:58.855868 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-197336e9-e64f-4786-bde8-b56f79bb9a7a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:58.858808 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-197336e9-e64f-4786-bde8-b56f79bb9a7a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:58.864993 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-197336e9-e64f-4786-bde8-b56f79bb9a7a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:58.865726 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-197336e9-e64f-4786-bde8-b56f79bb9a7a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:58.866742 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-197336e9-e64f-4786-bde8-b56f79bb9a7a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:58.867307 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-197336e9-e64f-4786-bde8-b56f79bb9a7a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:58.992779 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-197336e9-e64f-4786-bde8-b56f79bb9a7a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 19342 microversion: 2.20 time: 0.141262 Nov 15 12:41:58.997219 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 178/358] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:41:58 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 19342 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:41:59.091662 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-3ce13c7e-931a-4c4f-8d43-a699354fc252 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:59.092670 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-3ce13c7e-931a-4c4f-8d43-a699354fc252 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:59.100006 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3ce13c7e-931a-4c4f-8d43-a699354fc252 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:59.100721 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3ce13c7e-931a-4c4f-8d43-a699354fc252 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:59.101697 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3ce13c7e-931a-4c4f-8d43-a699354fc252 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:59.102133 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3ce13c7e-931a-4c4f-8d43-a699354fc252 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:59.395587 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-3ce13c7e-931a-4c4f-8d43-a699354fc252 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:59.407662 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-3ce13c7e-931a-4c4f-8d43-a699354fc252 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1515 microversion: 2.1 time: 0.319529 Nov 15 12:41:59.419765 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 181/359] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:59 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1515 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:59.425113 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-14d625e1-7189-4851-99d8-8217572ef85a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ffb6da6-a2ad-4d24-990b-77a1fe531307"}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:41:59.426343 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-14d625e1-7189-4851-99d8-8217572ef85a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:59.437247 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-14d625e1-7189-4851-99d8-8217572ef85a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:59.437708 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-14d625e1-7189-4851-99d8-8217572ef85a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:59.438509 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-14d625e1-7189-4851-99d8-8217572ef85a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:59.439926 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-14d625e1-7189-4851-99d8-8217572ef85a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:59.500113 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-2bc4da81-7b33-4e9f-aa29-4e951418beaf tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:41:59.500738 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-2bc4da81-7b33-4e9f-aa29-4e951418beaf tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: d7de1403-72dd-46fd-b7a0-97e4d6c201d9] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:41:59.507553 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2bc4da81-7b33-4e9f-aa29-4e951418beaf tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:59.508207 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2bc4da81-7b33-4e9f-aa29-4e951418beaf tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:59.510207 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2bc4da81-7b33-4e9f-aa29-4e951418beaf tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:41:59.510721 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2bc4da81-7b33-4e9f-aa29-4e951418beaf tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:41:59.772094 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-2bc4da81-7b33-4e9f-aa29-4e951418beaf tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44c99bd2e434807b12facc77f18a5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aae5c632c8b4d4f94206b1d6745c0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:41:59.790209 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-2bc4da81-7b33-4e9f-aa29-4e951418beaf tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "GET /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9" status: 200 len: 1319 microversion: 2.1 time: 0.295403 Nov 15 12:41:59.794838 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 182/360] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:41:59 2021] GET /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9 => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:41:59.806346 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-14d625e1-7189-4851-99d8-8217572ef85a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "POST /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.385494 Nov 15 12:41:59.812095 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 179/361] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Nov 15 12:41:59 2021] POST /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986/os-volume_attachments => generated 194 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:42:00.006551 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-9ae47f89-0c47-473f-92b8-9853c29a3e11 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:00.007853 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-9ae47f89-0c47-473f-92b8-9853c29a3e11 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:00.023867 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9ae47f89-0c47-473f-92b8-9853c29a3e11 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:00.029428 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9ae47f89-0c47-473f-92b8-9853c29a3e11 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:00.033289 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9ae47f89-0c47-473f-92b8-9853c29a3e11 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:00.034050 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9ae47f89-0c47-473f-92b8-9853c29a3e11 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:00.245084 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-9ae47f89-0c47-473f-92b8-9853c29a3e11 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 20990 microversion: 2.20 time: 0.243709 Nov 15 12:42:00.246632 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 183/362] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:41:59 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 20990 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:42:00.277733 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-56807934-3a71-4939-87c8-4e0ab6f4f140 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:00.290280 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-56807934-3a71-4939-87c8-4e0ab6f4f140 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:00.291085 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-56807934-3a71-4939-87c8-4e0ab6f4f140 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:00.361182 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-56807934-3a71-4939-87c8-4e0ab6f4f140 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Going to try to stop instance {{(pid=122568) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 15 12:42:00.556413 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-56807934-3a71-4939-87c8-4e0ab6f4f140 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 202 len: 0 microversion: 2.1 time: 0.285795 Nov 15 12:42:00.557879 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 180/363] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:42:00 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:42:00.568345 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-93602c68-8df9-4d63-ba8c-71ba3342a03f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:00.569676 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-93602c68-8df9-4d63-ba8c-71ba3342a03f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:00.585373 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-93602c68-8df9-4d63-ba8c-71ba3342a03f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:00.585860 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-93602c68-8df9-4d63-ba8c-71ba3342a03f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:00.588007 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-93602c68-8df9-4d63-ba8c-71ba3342a03f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:00.588648 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-93602c68-8df9-4d63-ba8c-71ba3342a03f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:00.814261 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-5e4ce4df-1c46-424a-85d3-5f94a067b0c0 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:00.815394 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-5e4ce4df-1c46-424a-85d3-5f94a067b0c0 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: d7de1403-72dd-46fd-b7a0-97e4d6c201d9] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:00.824813 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5e4ce4df-1c46-424a-85d3-5f94a067b0c0 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:00.826206 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5e4ce4df-1c46-424a-85d3-5f94a067b0c0 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:00.827550 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5e4ce4df-1c46-424a-85d3-5f94a067b0c0 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:00.828144 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5e4ce4df-1c46-424a-85d3-5f94a067b0c0 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:01.229999 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-5e4ce4df-1c46-424a-85d3-5f94a067b0c0 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44c99bd2e434807b12facc77f18a5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aae5c632c8b4d4f94206b1d6745c0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:01.235657 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-93602c68-8df9-4d63-ba8c-71ba3342a03f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:01.256497 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-93602c68-8df9-4d63-ba8c-71ba3342a03f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1723 microversion: 2.1 time: 0.694357 Nov 15 12:42:01.259018 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 184/364] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:00 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1723 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:01.266229 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-5e4ce4df-1c46-424a-85d3-5f94a067b0c0 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "GET /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9" status: 200 len: 1509 microversion: 2.1 time: 0.458366 Nov 15 12:42:01.277266 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-83aa561b-5545-4613-a0bb-477396da95de tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:01.277782 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 181/365] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:00 2021] GET /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9 => generated 1509 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:42:01.282088 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-83aa561b-5545-4613-a0bb-477396da95de tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:01.307200 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-83aa561b-5545-4613-a0bb-477396da95de tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:01.310684 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-83aa561b-5545-4613-a0bb-477396da95de tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:01.313596 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-83aa561b-5545-4613-a0bb-477396da95de tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:01.314045 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-83aa561b-5545-4613-a0bb-477396da95de tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:01.493907 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-83aa561b-5545-4613-a0bb-477396da95de tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 22708 microversion: 2.20 time: 0.233596 Nov 15 12:42:01.494905 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 185/366] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:42:01 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 22708 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:42:02.277610 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-2d049cb5-b818-45c1-b67d-b82eeb17ad45 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:02.279623 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-2d049cb5-b818-45c1-b67d-b82eeb17ad45 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:02.297291 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2d049cb5-b818-45c1-b67d-b82eeb17ad45 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:02.300458 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2d049cb5-b818-45c1-b67d-b82eeb17ad45 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:02.301512 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2d049cb5-b818-45c1-b67d-b82eeb17ad45 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:02.302946 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2d049cb5-b818-45c1-b67d-b82eeb17ad45 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:02.506578 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-c36c2fe5-59d5-4779-97fb-c4aea8c540c5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:02.508455 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-c36c2fe5-59d5-4779-97fb-c4aea8c540c5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:02.525028 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c36c2fe5-59d5-4779-97fb-c4aea8c540c5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:02.525708 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c36c2fe5-59d5-4779-97fb-c4aea8c540c5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:02.528093 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c36c2fe5-59d5-4779-97fb-c4aea8c540c5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:02.531011 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c36c2fe5-59d5-4779-97fb-c4aea8c540c5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:02.652828 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-2d049cb5-b818-45c1-b67d-b82eeb17ad45 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:02.663107 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-2d049cb5-b818-45c1-b67d-b82eeb17ad45 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1723 microversion: 2.1 time: 0.389439 Nov 15 12:42:02.664132 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 182/367] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:02 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1723 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:02.691168 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-c36c2fe5-59d5-4779-97fb-c4aea8c540c5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 23553 microversion: 2.20 time: 0.188776 Nov 15 12:42:02.692120 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 186/368] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:42:02 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 23553 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 15 12:42:03.685290 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-72115d9c-f913-49df-a36a-105c73adc407 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:03.686085 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-72115d9c-f913-49df-a36a-105c73adc407 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:03.698873 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-72115d9c-f913-49df-a36a-105c73adc407 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:03.699327 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-72115d9c-f913-49df-a36a-105c73adc407 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:03.700178 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-72115d9c-f913-49df-a36a-105c73adc407 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:03.701809 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-72115d9c-f913-49df-a36a-105c73adc407 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:03.704410 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-9d286503-6414-415e-a729-cea0ad5ed43c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:03.706115 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-9d286503-6414-415e-a729-cea0ad5ed43c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:03.721468 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9d286503-6414-415e-a729-cea0ad5ed43c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:03.721916 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9d286503-6414-415e-a729-cea0ad5ed43c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:03.723383 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9d286503-6414-415e-a729-cea0ad5ed43c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:03.723987 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9d286503-6414-415e-a729-cea0ad5ed43c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:03.861014 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-9d286503-6414-415e-a729-cea0ad5ed43c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 24405 microversion: 2.20 time: 0.161130 Nov 15 12:42:03.861787 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 187/369] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:42:03 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 24405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:42:04.006457 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-72115d9c-f913-49df-a36a-105c73adc407 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:04.018710 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-72115d9c-f913-49df-a36a-105c73adc407 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1723 microversion: 2.1 time: 0.340045 Nov 15 12:42:04.020144 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 183/370] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:03 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1723 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:04.584230 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-2c07d949-9266-41f3-9df5-b108581dcafe tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Action: 'create', calling method: .version_select at 0x7f13205843a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1893789649"}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:04.605464 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.quota [None req-2c07d949-9266-41f3-9df5-b108581dcafe tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Getting quotas for project e7191bcfe4454fd9b47db87e8aa6e497. Resources: {'key_pairs'} {{(pid=122567) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:42:04.609645 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.quota [None req-2c07d949-9266-41f3-9df5-b108581dcafe tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Getting quotas for user ba0fb21696184f6ea168fa860bf7d427 and project e7191bcfe4454fd9b47db87e8aa6e497. Resources: {'key_pairs'} {{(pid=122567) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:42:04.780785 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.quota [None req-2c07d949-9266-41f3-9df5-b108581dcafe tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Getting quotas for project e7191bcfe4454fd9b47db87e8aa6e497. Resources: {'key_pairs'} {{(pid=122567) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:42:04.784519 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.quota [None req-2c07d949-9266-41f3-9df5-b108581dcafe tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Getting quotas for user ba0fb21696184f6ea168fa860bf7d427 and project e7191bcfe4454fd9b47db87e8aa6e497. Resources: {'key_pairs'} {{(pid=122567) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:42:04.798510 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-2c07d949-9266-41f3-9df5-b108581dcafe tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.422098 Nov 15 12:42:04.799227 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 188/371] 10.222.0.43 () {60 vars in 1157 bytes} [Mon Nov 15 12:42:04 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:04.871807 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-b334f4b5-ebe1-42fa-956d-e03be8184cc0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:04.873390 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-b334f4b5-ebe1-42fa-956d-e03be8184cc0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:04.879918 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b334f4b5-ebe1-42fa-956d-e03be8184cc0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:04.880362 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b334f4b5-ebe1-42fa-956d-e03be8184cc0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:04.881175 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b334f4b5-ebe1-42fa-956d-e03be8184cc0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:04.881630 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b334f4b5-ebe1-42fa-956d-e03be8184cc0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:05.017566 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-b334f4b5-ebe1-42fa-956d-e03be8184cc0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 25282 microversion: 2.20 time: 0.149384 Nov 15 12:42:05.018336 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 184/372] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:42:04 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 25282 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:42:05.038087 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-3cd9ed8a-b203-4071-aefe-aef2beefba54 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:05.038993 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-3cd9ed8a-b203-4071-aefe-aef2beefba54 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:05.050151 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3cd9ed8a-b203-4071-aefe-aef2beefba54 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:05.050614 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3cd9ed8a-b203-4071-aefe-aef2beefba54 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:05.051471 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3cd9ed8a-b203-4071-aefe-aef2beefba54 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:05.051911 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3cd9ed8a-b203-4071-aefe-aef2beefba54 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:05.224330 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-3cd9ed8a-b203-4071-aefe-aef2beefba54 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:05.243260 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-3cd9ed8a-b203-4071-aefe-aef2beefba54 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1723 microversion: 2.1 time: 0.209250 Nov 15 12:42:05.245346 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 189/373] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:05 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:06.030609 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-75475ea8-b530-484d-9f36-b06ae8911602 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:06.034811 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-75475ea8-b530-484d-9f36-b06ae8911602 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:06.041759 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-75475ea8-b530-484d-9f36-b06ae8911602 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:06.042463 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-75475ea8-b530-484d-9f36-b06ae8911602 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:06.043434 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-75475ea8-b530-484d-9f36-b06ae8911602 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:06.044022 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-75475ea8-b530-484d-9f36-b06ae8911602 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:06.268494 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-b37f45d9-532b-4800-84f4-5e76bc4574e8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:06.269813 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-b37f45d9-532b-4800-84f4-5e76bc4574e8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:06.276902 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b37f45d9-532b-4800-84f4-5e76bc4574e8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:06.277341 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b37f45d9-532b-4800-84f4-5e76bc4574e8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:06.279560 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b37f45d9-532b-4800-84f4-5e76bc4574e8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:06.280336 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b37f45d9-532b-4800-84f4-5e76bc4574e8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:06.507093 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-b37f45d9-532b-4800-84f4-5e76bc4574e8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:06.516542 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-b37f45d9-532b-4800-84f4-5e76bc4574e8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1723 microversion: 2.1 time: 0.253626 Nov 15 12:42:06.517134 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 190/374] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:06 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:07.534435 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-608fa3ce-bec9-4522-ba46-be01ed32a53a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:07.535177 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-608fa3ce-bec9-4522-ba46-be01ed32a53a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:07.541989 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-608fa3ce-bec9-4522-ba46-be01ed32a53a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:07.542435 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-608fa3ce-bec9-4522-ba46-be01ed32a53a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:07.543287 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-608fa3ce-bec9-4522-ba46-be01ed32a53a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:07.543732 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-608fa3ce-bec9-4522-ba46-be01ed32a53a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:07.686971 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-608fa3ce-bec9-4522-ba46-be01ed32a53a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:07.695295 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-608fa3ce-bec9-4522-ba46-be01ed32a53a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1723 microversion: 2.1 time: 0.164396 Nov 15 12:42:07.695888 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 191/375] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:07 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:08.322248 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-75475ea8-b530-484d-9f36-b06ae8911602 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 27213 microversion: 2.20 time: 2.296198 Nov 15 12:42:08.322990 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 185/376] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:42:06 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 27213 bytes in 2298 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:42:08.713195 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-fa121482-9d76-41de-a229-c31a6e0009ad tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:08.713731 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-fa121482-9d76-41de-a229-c31a6e0009ad tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:08.722177 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-fa121482-9d76-41de-a229-c31a6e0009ad tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:08.722620 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-fa121482-9d76-41de-a229-c31a6e0009ad tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:08.723484 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-fa121482-9d76-41de-a229-c31a6e0009ad tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:08.723910 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-fa121482-9d76-41de-a229-c31a6e0009ad tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:08.860318 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-fa121482-9d76-41de-a229-c31a6e0009ad tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:08.868156 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-fa121482-9d76-41de-a229-c31a6e0009ad tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1723 microversion: 2.1 time: 0.158662 Nov 15 12:42:08.868710 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 192/377] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:08 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:09.334216 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-0a254565-4d5e-44fe-9048-7a9e10fcdac1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:09.335263 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-0a254565-4d5e-44fe-9048-7a9e10fcdac1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:09.344892 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0a254565-4d5e-44fe-9048-7a9e10fcdac1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:09.345395 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0a254565-4d5e-44fe-9048-7a9e10fcdac1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:09.346111 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0a254565-4d5e-44fe-9048-7a9e10fcdac1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:09.346543 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0a254565-4d5e-44fe-9048-7a9e10fcdac1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:09.460295 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-0a254565-4d5e-44fe-9048-7a9e10fcdac1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 27610 microversion: 2.20 time: 0.130025 Nov 15 12:42:09.460957 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 186/378] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:42:09 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 27610 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:42:09.886212 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-4daed980-5ddb-4f96-9762-ae365fa603cb tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:09.886750 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-4daed980-5ddb-4f96-9762-ae365fa603cb tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:09.893946 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4daed980-5ddb-4f96-9762-ae365fa603cb tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:09.894395 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4daed980-5ddb-4f96-9762-ae365fa603cb tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:09.895219 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4daed980-5ddb-4f96-9762-ae365fa603cb tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:09.895651 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4daed980-5ddb-4f96-9762-ae365fa603cb tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:10.031043 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-4daed980-5ddb-4f96-9762-ae365fa603cb tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:10.039008 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-4daed980-5ddb-4f96-9762-ae365fa603cb tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1723 microversion: 2.1 time: 0.157200 Nov 15 12:42:10.039556 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 193/379] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:09 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:10.472728 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-6c7257b4-867d-49b8-966a-02e84a90b711 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:10.473717 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-6c7257b4-867d-49b8-966a-02e84a90b711 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:10.480540 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6c7257b4-867d-49b8-966a-02e84a90b711 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:10.480981 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6c7257b4-867d-49b8-966a-02e84a90b711 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:10.482318 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6c7257b4-867d-49b8-966a-02e84a90b711 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:10.487526 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6c7257b4-867d-49b8-966a-02e84a90b711 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:10.602124 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-6c7257b4-867d-49b8-966a-02e84a90b711 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 27824 microversion: 2.20 time: 0.133111 Nov 15 12:42:10.602443 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 187/380] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:42:10 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 27824 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:42:11.056879 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-47bb4236-54a9-4e1a-a3ba-84be6b7402f4 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:11.057424 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-47bb4236-54a9-4e1a-a3ba-84be6b7402f4 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:11.064385 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-47bb4236-54a9-4e1a-a3ba-84be6b7402f4 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:11.064835 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-47bb4236-54a9-4e1a-a3ba-84be6b7402f4 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:11.065614 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-47bb4236-54a9-4e1a-a3ba-84be6b7402f4 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:11.066044 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-47bb4236-54a9-4e1a-a3ba-84be6b7402f4 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:11.202862 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-47bb4236-54a9-4e1a-a3ba-84be6b7402f4 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:11.211104 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-47bb4236-54a9-4e1a-a3ba-84be6b7402f4 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1723 microversion: 2.1 time: 0.157979 Nov 15 12:42:11.211674 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 194/381] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:11 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:11.614208 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-136cda00-9c1c-463b-a988-ba648fb56574 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:11.615310 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-136cda00-9c1c-463b-a988-ba648fb56574 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:11.622469 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-136cda00-9c1c-463b-a988-ba648fb56574 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:11.622943 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-136cda00-9c1c-463b-a988-ba648fb56574 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:11.623712 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-136cda00-9c1c-463b-a988-ba648fb56574 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:11.624140 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-136cda00-9c1c-463b-a988-ba648fb56574 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:11.766307 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-136cda00-9c1c-463b-a988-ba648fb56574 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 28037 microversion: 2.20 time: 0.156163 Nov 15 12:42:11.767343 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 188/382] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:42:11 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 28037 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:42:12.228664 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-d13161b3-e5d0-433f-b15c-3574bf50fb10 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:12.229269 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-d13161b3-e5d0-433f-b15c-3574bf50fb10 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:12.236173 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d13161b3-e5d0-433f-b15c-3574bf50fb10 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:12.236616 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d13161b3-e5d0-433f-b15c-3574bf50fb10 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:12.237387 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d13161b3-e5d0-433f-b15c-3574bf50fb10 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:12.237815 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d13161b3-e5d0-433f-b15c-3574bf50fb10 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:12.375807 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-d13161b3-e5d0-433f-b15c-3574bf50fb10 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:12.383674 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-d13161b3-e5d0-433f-b15c-3574bf50fb10 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1723 microversion: 2.1 time: 0.159016 Nov 15 12:42:12.384242 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 195/383] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:12 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:12.778686 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-b8c212da-ad9c-4c2d-8b6f-98ffa544e670 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:12.780235 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-b8c212da-ad9c-4c2d-8b6f-98ffa544e670 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:12.788708 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b8c212da-ad9c-4c2d-8b6f-98ffa544e670 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:12.789153 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b8c212da-ad9c-4c2d-8b6f-98ffa544e670 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:12.789944 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b8c212da-ad9c-4c2d-8b6f-98ffa544e670 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:12.790516 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b8c212da-ad9c-4c2d-8b6f-98ffa544e670 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:12.912484 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-b8c212da-ad9c-4c2d-8b6f-98ffa544e670 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 28190 microversion: 2.20 time: 0.138297 Nov 15 12:42:12.913139 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 189/384] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:42:12 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 28190 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:42:13.399827 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-6db71832-6050-4764-a2d6-201e9655ef4e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:13.400380 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-6db71832-6050-4764-a2d6-201e9655ef4e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:13.407301 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6db71832-6050-4764-a2d6-201e9655ef4e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:13.407742 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6db71832-6050-4764-a2d6-201e9655ef4e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:13.408507 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6db71832-6050-4764-a2d6-201e9655ef4e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:13.408928 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6db71832-6050-4764-a2d6-201e9655ef4e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:13.541338 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-6db71832-6050-4764-a2d6-201e9655ef4e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:13.550299 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-6db71832-6050-4764-a2d6-201e9655ef4e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1723 microversion: 2.1 time: 0.154111 Nov 15 12:42:13.551069 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 196/385] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:13 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:13.925434 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-f6bb21a9-db38-4054-91c3-a41a228afc19 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:13.926428 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-f6bb21a9-db38-4054-91c3-a41a228afc19 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:13.934382 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f6bb21a9-db38-4054-91c3-a41a228afc19 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:13.934961 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f6bb21a9-db38-4054-91c3-a41a228afc19 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:13.936051 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f6bb21a9-db38-4054-91c3-a41a228afc19 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:13.936550 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f6bb21a9-db38-4054-91c3-a41a228afc19 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:14.048028 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-f6bb21a9-db38-4054-91c3-a41a228afc19 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 28190 microversion: 2.20 time: 0.126784 Nov 15 12:42:14.049050 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 190/386] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:42:13 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 28190 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:42:14.568342 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-1dd4b51a-2b84-429b-9e99-2ddca1b01c28 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:14.569038 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-1dd4b51a-2b84-429b-9e99-2ddca1b01c28 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:14.576021 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1dd4b51a-2b84-429b-9e99-2ddca1b01c28 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:14.576483 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1dd4b51a-2b84-429b-9e99-2ddca1b01c28 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:14.579375 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1dd4b51a-2b84-429b-9e99-2ddca1b01c28 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:14.579853 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1dd4b51a-2b84-429b-9e99-2ddca1b01c28 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:14.732425 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-1dd4b51a-2b84-429b-9e99-2ddca1b01c28 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:14.740433 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-1dd4b51a-2b84-429b-9e99-2ddca1b01c28 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1723 microversion: 2.1 time: 0.175756 Nov 15 12:42:14.741147 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 197/387] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:14 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:14.922764 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-77a8f2c0-9134-4da8-8336-b2cde744553e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:14.924191 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-77a8f2c0-9134-4da8-8336-b2cde744553e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:14.932613 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-77a8f2c0-9134-4da8-8336-b2cde744553e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:14.933260 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-77a8f2c0-9134-4da8-8336-b2cde744553e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:14.933813 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-77a8f2c0-9134-4da8-8336-b2cde744553e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:14.934292 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-77a8f2c0-9134-4da8-8336-b2cde744553e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:14.959598 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.objects.instance [None req-77a8f2c0-9134-4da8-8336-b2cde744553e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lazy-loading 'flavor' on Instance uuid aea00c4f-da8f-4b9e-8c12-7ebe91776986 {{(pid=122568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 15 12:42:15.060469 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-736a63f1-c470-4a5d-a0dd-034f4a329e73 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:15.061461 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-736a63f1-c470-4a5d-a0dd-034f4a329e73 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:15.067466 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-736a63f1-c470-4a5d-a0dd-034f4a329e73 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:15.067998 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-736a63f1-c470-4a5d-a0dd-034f4a329e73 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:15.068708 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-736a63f1-c470-4a5d-a0dd-034f4a329e73 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:15.069146 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-736a63f1-c470-4a5d-a0dd-034f4a329e73 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:15.088462 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-77a8f2c0-9134-4da8-8336-b2cde744553e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "POST /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986/action" status: 200 len: 32 microversion: 2.1 time: 0.171175 Nov 15 12:42:15.094123 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 191/388] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:42:14 2021] POST /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986/action => generated 32 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 15 12:42:15.099817 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-2e6d7cbd-9c4c-4d59-be1a-2e41589b106b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:15.101032 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-2e6d7cbd-9c4c-4d59-be1a-2e41589b106b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:15.116394 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2e6d7cbd-9c4c-4d59-be1a-2e41589b106b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:15.116949 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2e6d7cbd-9c4c-4d59-be1a-2e41589b106b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:15.117828 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2e6d7cbd-9c4c-4d59-be1a-2e41589b106b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:15.118333 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2e6d7cbd-9c4c-4d59-be1a-2e41589b106b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:15.222809 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-736a63f1-c470-4a5d-a0dd-034f4a329e73 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 28190 microversion: 2.20 time: 0.166407 Nov 15 12:42:15.223486 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 198/389] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:42:15 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 28190 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 15 12:42:15.348001 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-2e6d7cbd-9c4c-4d59-be1a-2e41589b106b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:15.356926 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-2e6d7cbd-9c4c-4d59-be1a-2e41589b106b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1567 microversion: 2.1 time: 0.260702 Nov 15 12:42:15.358127 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 192/390] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:15 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1567 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:42:15.758021 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-be423332-96fa-48b1-a6d9-ee49ff880a19 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:15.758724 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-be423332-96fa-48b1-a6d9-ee49ff880a19 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:15.766511 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-be423332-96fa-48b1-a6d9-ee49ff880a19 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:15.767063 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-be423332-96fa-48b1-a6d9-ee49ff880a19 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:15.767916 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-be423332-96fa-48b1-a6d9-ee49ff880a19 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:15.768438 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-be423332-96fa-48b1-a6d9-ee49ff880a19 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:15.909009 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-be423332-96fa-48b1-a6d9-ee49ff880a19 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:15.916931 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-be423332-96fa-48b1-a6d9-ee49ff880a19 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1723 microversion: 2.1 time: 0.163210 Nov 15 12:42:15.917503 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 199/391] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:15 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:16.235254 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-84438d6a-02c2-4142-aed6-8bb33f9fe260 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:16.236186 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-84438d6a-02c2-4142-aed6-8bb33f9fe260 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:16.242510 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-84438d6a-02c2-4142-aed6-8bb33f9fe260 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:16.242986 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-84438d6a-02c2-4142-aed6-8bb33f9fe260 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:16.243753 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-84438d6a-02c2-4142-aed6-8bb33f9fe260 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:16.244178 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-84438d6a-02c2-4142-aed6-8bb33f9fe260 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:16.369138 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-84438d6a-02c2-4142-aed6-8bb33f9fe260 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 28314 microversion: 2.20 time: 0.137406 Nov 15 12:42:16.370380 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 193/392] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:42:16 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 28314 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:42:16.376101 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-ca6ae68f-17a0-4348-8ce9-b1fe477e97c1 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:16.376722 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-ca6ae68f-17a0-4348-8ce9-b1fe477e97c1 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:16.383138 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ca6ae68f-17a0-4348-8ce9-b1fe477e97c1 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:16.383585 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ca6ae68f-17a0-4348-8ce9-b1fe477e97c1 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:16.384375 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ca6ae68f-17a0-4348-8ce9-b1fe477e97c1 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:16.384810 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ca6ae68f-17a0-4348-8ce9-b1fe477e97c1 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:16.532824 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-ca6ae68f-17a0-4348-8ce9-b1fe477e97c1 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:16.541755 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-ca6ae68f-17a0-4348-8ce9-b1fe477e97c1 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1567 microversion: 2.1 time: 0.169723 Nov 15 12:42:16.542333 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 200/393] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:16 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:16.579452 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-3360296f-0325-4a6f-819b-51eb17553eee tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1960791104", "imageRef": "3cc21e2c-27da-4266-be76-369023341c16", "flavorRef": "452"}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:16.934661 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-26b9d0cf-adc9-42bc-b858-a0af730e27af tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:16.935423 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-26b9d0cf-adc9-42bc-b858-a0af730e27af tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:16.942228 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-26b9d0cf-adc9-42bc-b858-a0af730e27af tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:16.943002 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-26b9d0cf-adc9-42bc-b858-a0af730e27af tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:16.944286 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-26b9d0cf-adc9-42bc-b858-a0af730e27af tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:16.945001 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-26b9d0cf-adc9-42bc-b858-a0af730e27af tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:17.081322 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-26b9d0cf-adc9-42bc-b858-a0af730e27af tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:17.089551 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-26b9d0cf-adc9-42bc-b858-a0af730e27af tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1723 microversion: 2.1 time: 0.158674 Nov 15 12:42:17.090123 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 201/394] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:16 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:17.381342 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-bbb54502-9550-4943-9e39-cff9cc9c5419 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:17.382157 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-bbb54502-9550-4943-9e39-cff9cc9c5419 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:17.388334 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bbb54502-9550-4943-9e39-cff9cc9c5419 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:17.388769 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bbb54502-9550-4943-9e39-cff9cc9c5419 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:17.389537 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bbb54502-9550-4943-9e39-cff9cc9c5419 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:17.389964 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bbb54502-9550-4943-9e39-cff9cc9c5419 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:17.517889 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-bbb54502-9550-4943-9e39-cff9cc9c5419 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 28479 microversion: 2.20 time: 0.139746 Nov 15 12:42:17.518867 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 202/395] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:42:17 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 28479 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 15 12:42:17.560588 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-8729b59d-3294-45fd-b3ff-c19d53affeaa tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:17.561307 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-8729b59d-3294-45fd-b3ff-c19d53affeaa tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:17.568262 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8729b59d-3294-45fd-b3ff-c19d53affeaa tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:17.568702 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8729b59d-3294-45fd-b3ff-c19d53affeaa tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:17.569481 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8729b59d-3294-45fd-b3ff-c19d53affeaa tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:17.569903 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8729b59d-3294-45fd-b3ff-c19d53affeaa tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:17.705027 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-8729b59d-3294-45fd-b3ff-c19d53affeaa tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:17.712781 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-8729b59d-3294-45fd-b3ff-c19d53affeaa tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1567 microversion: 2.1 time: 0.156976 Nov 15 12:42:17.713350 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 203/396] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:17 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:42:18.107277 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-2319822a-c296-4149-afad-102da303f9a5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:18.107955 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-2319822a-c296-4149-afad-102da303f9a5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:18.114278 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2319822a-c296-4149-afad-102da303f9a5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:18.114721 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2319822a-c296-4149-afad-102da303f9a5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:18.115520 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2319822a-c296-4149-afad-102da303f9a5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:18.115946 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2319822a-c296-4149-afad-102da303f9a5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:18.467883 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-2319822a-c296-4149-afad-102da303f9a5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:18.476295 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-2319822a-c296-4149-afad-102da303f9a5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1723 microversion: 2.1 time: 0.372708 Nov 15 12:42:18.476874 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 204/397] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:18 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1723 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:42:18.531296 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-2717b721-b7e5-4105-b3aa-f43ddc725a7e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:18.532223 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-2717b721-b7e5-4105-b3aa-f43ddc725a7e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:18.538307 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2717b721-b7e5-4105-b3aa-f43ddc725a7e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:18.538753 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2717b721-b7e5-4105-b3aa-f43ddc725a7e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:18.539761 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2717b721-b7e5-4105-b3aa-f43ddc725a7e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:18.540217 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2717b721-b7e5-4105-b3aa-f43ddc725a7e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:18.665362 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-2717b721-b7e5-4105-b3aa-f43ddc725a7e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 28479 microversion: 2.20 time: 0.139017 Nov 15 12:42:18.666469 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 205/398] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:42:18 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 28479 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 15 12:42:18.731957 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-050c7663-5186-4044-9f5e-ef7de30a0876 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:18.732559 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-050c7663-5186-4044-9f5e-ef7de30a0876 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:18.739073 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-050c7663-5186-4044-9f5e-ef7de30a0876 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:18.739526 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-050c7663-5186-4044-9f5e-ef7de30a0876 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:18.740312 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-050c7663-5186-4044-9f5e-ef7de30a0876 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:18.740743 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-050c7663-5186-4044-9f5e-ef7de30a0876 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:18.880823 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-050c7663-5186-4044-9f5e-ef7de30a0876 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:18.890138 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-050c7663-5186-4044-9f5e-ef7de30a0876 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1567 microversion: 2.1 time: 0.163229 Nov 15 12:42:18.890897 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 206/399] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:18 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:42:19.495380 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-77fdc328-a39f-4168-9cfb-825b7d294edc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:19.496034 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-77fdc328-a39f-4168-9cfb-825b7d294edc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:19.503391 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-77fdc328-a39f-4168-9cfb-825b7d294edc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:19.503836 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-77fdc328-a39f-4168-9cfb-825b7d294edc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:19.504622 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-77fdc328-a39f-4168-9cfb-825b7d294edc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:19.505054 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-77fdc328-a39f-4168-9cfb-825b7d294edc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:19.639448 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-77fdc328-a39f-4168-9cfb-825b7d294edc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:19.647422 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-77fdc328-a39f-4168-9cfb-825b7d294edc tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1723 microversion: 2.1 time: 0.156134 Nov 15 12:42:19.648000 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 207/400] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:19 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:42:19.677803 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-d2861151-db06-46b6-857a-59622188c0f6 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:19.678878 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-d2861151-db06-46b6-857a-59622188c0f6 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:19.685735 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d2861151-db06-46b6-857a-59622188c0f6 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:19.686166 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d2861151-db06-46b6-857a-59622188c0f6 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:19.686956 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d2861151-db06-46b6-857a-59622188c0f6 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:19.687380 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d2861151-db06-46b6-857a-59622188c0f6 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:19.803078 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-d2861151-db06-46b6-857a-59622188c0f6 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 28646 microversion: 2.20 time: 0.128670 Nov 15 12:42:19.803866 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 208/401] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:42:19 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 28646 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 15 12:42:19.909129 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-3466270e-cf97-4022-a3b2-675f8b873150 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:19.909793 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-3466270e-cf97-4022-a3b2-675f8b873150 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:19.916980 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3466270e-cf97-4022-a3b2-675f8b873150 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:19.917423 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3466270e-cf97-4022-a3b2-675f8b873150 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:19.918501 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3466270e-cf97-4022-a3b2-675f8b873150 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:19.919181 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3466270e-cf97-4022-a3b2-675f8b873150 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:20.064295 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-3466270e-cf97-4022-a3b2-675f8b873150 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:20.072252 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-3466270e-cf97-4022-a3b2-675f8b873150 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1567 microversion: 2.1 time: 0.167724 Nov 15 12:42:20.072814 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 209/402] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:19 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:20.664833 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-0b56de1a-7485-45fe-a040-84a94ee25960 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:20.665463 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-0b56de1a-7485-45fe-a040-84a94ee25960 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:20.672654 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0b56de1a-7485-45fe-a040-84a94ee25960 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:20.673362 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0b56de1a-7485-45fe-a040-84a94ee25960 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:20.674160 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0b56de1a-7485-45fe-a040-84a94ee25960 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:20.674572 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0b56de1a-7485-45fe-a040-84a94ee25960 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:20.810744 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-0b56de1a-7485-45fe-a040-84a94ee25960 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:20.818695 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-0b56de1a-7485-45fe-a040-84a94ee25960 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1723 microversion: 2.1 time: 0.157593 Nov 15 12:42:20.819303 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 210/403] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:20 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:42:20.823652 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-3b1eb18c-2a5a-467e-9e76-07e81c6529d7 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:20.824648 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-3b1eb18c-2a5a-467e-9e76-07e81c6529d7 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:20.831001 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3b1eb18c-2a5a-467e-9e76-07e81c6529d7 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:20.831446 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3b1eb18c-2a5a-467e-9e76-07e81c6529d7 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:20.832214 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3b1eb18c-2a5a-467e-9e76-07e81c6529d7 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:20.832643 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3b1eb18c-2a5a-467e-9e76-07e81c6529d7 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:20.944088 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-3b1eb18c-2a5a-467e-9e76-07e81c6529d7 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 28646 microversion: 2.20 time: 0.123489 Nov 15 12:42:20.945670 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 211/404] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:42:20 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 28646 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:42:21.091898 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-3f063e0d-7c21-4ae3-b4e3-9b74b4afdfd9 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:21.092600 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-3f063e0d-7c21-4ae3-b4e3-9b74b4afdfd9 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:21.100831 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3f063e0d-7c21-4ae3-b4e3-9b74b4afdfd9 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:21.101305 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3f063e0d-7c21-4ae3-b4e3-9b74b4afdfd9 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:21.102096 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3f063e0d-7c21-4ae3-b4e3-9b74b4afdfd9 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:21.102537 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3f063e0d-7c21-4ae3-b4e3-9b74b4afdfd9 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:21.242900 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-3f063e0d-7c21-4ae3-b4e3-9b74b4afdfd9 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:21.251426 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-3f063e0d-7c21-4ae3-b4e3-9b74b4afdfd9 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1567 microversion: 2.1 time: 0.164376 Nov 15 12:42:21.251995 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 212/405] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:21 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:42:21.836903 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-99f7b3de-f58f-43be-be92-8290b8111158 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:21.837528 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-99f7b3de-f58f-43be-be92-8290b8111158 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:21.844795 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-99f7b3de-f58f-43be-be92-8290b8111158 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:21.845239 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-99f7b3de-f58f-43be-be92-8290b8111158 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:21.846015 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-99f7b3de-f58f-43be-be92-8290b8111158 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:21.846441 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-99f7b3de-f58f-43be-be92-8290b8111158 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:21.987008 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-99f7b3de-f58f-43be-be92-8290b8111158 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:21.995735 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-99f7b3de-f58f-43be-be92-8290b8111158 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1723 microversion: 2.1 time: 0.162471 Nov 15 12:42:21.996331 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 213/406] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:21 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:42:22.002162 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-9b460271-1003-4cc4-8525-421e0d2d835e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:22.003111 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-9b460271-1003-4cc4-8525-421e0d2d835e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:22.009090 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9b460271-1003-4cc4-8525-421e0d2d835e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:22.009535 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9b460271-1003-4cc4-8525-421e0d2d835e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:22.010342 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9b460271-1003-4cc4-8525-421e0d2d835e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:22.010792 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9b460271-1003-4cc4-8525-421e0d2d835e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:22.110058 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-9b460271-1003-4cc4-8525-421e0d2d835e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 28646 microversion: 2.20 time: 0.111373 Nov 15 12:42:22.110623 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 214/407] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:42:21 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 28646 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:42:22.268948 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-451b56ac-feb0-45e3-ab6a-1c06080b62c9 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:22.269631 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-451b56ac-feb0-45e3-ab6a-1c06080b62c9 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:22.276524 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-451b56ac-feb0-45e3-ab6a-1c06080b62c9 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:22.276968 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-451b56ac-feb0-45e3-ab6a-1c06080b62c9 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:22.278288 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-451b56ac-feb0-45e3-ab6a-1c06080b62c9 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:22.279541 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-451b56ac-feb0-45e3-ab6a-1c06080b62c9 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:22.420766 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-451b56ac-feb0-45e3-ab6a-1c06080b62c9 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:22.428851 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-451b56ac-feb0-45e3-ab6a-1c06080b62c9 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1567 microversion: 2.1 time: 0.164018 Nov 15 12:42:22.429415 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 215/408] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:22 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:42:23.014335 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-2b226ef5-b2c9-4613-a4a5-63329dcbad11 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:23.015044 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-2b226ef5-b2c9-4613-a4a5-63329dcbad11 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:23.021310 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2b226ef5-b2c9-4613-a4a5-63329dcbad11 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:23.021757 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2b226ef5-b2c9-4613-a4a5-63329dcbad11 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:23.022530 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2b226ef5-b2c9-4613-a4a5-63329dcbad11 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:23.022999 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2b226ef5-b2c9-4613-a4a5-63329dcbad11 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:23.157231 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-2b226ef5-b2c9-4613-a4a5-63329dcbad11 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:23.171330 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-2b226ef5-b2c9-4613-a4a5-63329dcbad11 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1723 microversion: 2.1 time: 0.161356 Nov 15 12:42:23.171919 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 216/409] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:23 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:42:23.176840 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-0e918bf5-d060-4996-9699-6ac919d1b83f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:23.177762 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-0e918bf5-d060-4996-9699-6ac919d1b83f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:23.185735 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0e918bf5-d060-4996-9699-6ac919d1b83f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:23.185735 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0e918bf5-d060-4996-9699-6ac919d1b83f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:23.186333 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0e918bf5-d060-4996-9699-6ac919d1b83f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:23.186838 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0e918bf5-d060-4996-9699-6ac919d1b83f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:23.284660 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-0e918bf5-d060-4996-9699-6ac919d1b83f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 28646 microversion: 2.20 time: 0.111428 Nov 15 12:42:23.285468 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 217/410] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:42:23 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 28646 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:42:23.446293 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-66cc8c9b-710a-4469-9018-bbddf23fc54b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:23.447049 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-66cc8c9b-710a-4469-9018-bbddf23fc54b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:23.454402 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-66cc8c9b-710a-4469-9018-bbddf23fc54b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:23.454884 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-66cc8c9b-710a-4469-9018-bbddf23fc54b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:23.455662 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-66cc8c9b-710a-4469-9018-bbddf23fc54b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:23.456098 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-66cc8c9b-710a-4469-9018-bbddf23fc54b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:23.592686 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-66cc8c9b-710a-4469-9018-bbddf23fc54b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:23.600637 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-66cc8c9b-710a-4469-9018-bbddf23fc54b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1567 microversion: 2.1 time: 0.158454 Nov 15 12:42:23.601212 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 218/411] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:23 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:42:24.188929 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-eb0e79a5-f541-4426-956b-09497dd25e61 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:24.189880 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-eb0e79a5-f541-4426-956b-09497dd25e61 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:24.196568 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-eb0e79a5-f541-4426-956b-09497dd25e61 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:24.197087 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-eb0e79a5-f541-4426-956b-09497dd25e61 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:24.198123 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-eb0e79a5-f541-4426-956b-09497dd25e61 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:24.198495 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-eb0e79a5-f541-4426-956b-09497dd25e61 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:24.345625 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-eb0e79a5-f541-4426-956b-09497dd25e61 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:24.353529 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-eb0e79a5-f541-4426-956b-09497dd25e61 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1723 microversion: 2.1 time: 0.168278 Nov 15 12:42:24.354095 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 219/412] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:24 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:42:24.359316 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-49fd112e-26b4-4029-8abe-b18bc79616bc tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:24.360220 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-49fd112e-26b4-4029-8abe-b18bc79616bc tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:24.366886 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-49fd112e-26b4-4029-8abe-b18bc79616bc tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:24.367322 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-49fd112e-26b4-4029-8abe-b18bc79616bc tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:24.368151 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-49fd112e-26b4-4029-8abe-b18bc79616bc tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:24.368571 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-49fd112e-26b4-4029-8abe-b18bc79616bc tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:24.476750 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-49fd112e-26b4-4029-8abe-b18bc79616bc tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 28646 microversion: 2.20 time: 0.121356 Nov 15 12:42:24.477398 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 220/413] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:42:24 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 28646 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:42:24.619128 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-bdcc7c6d-0472-46a1-b85d-619898b59f05 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:24.619913 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-bdcc7c6d-0472-46a1-b85d-619898b59f05 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:24.627086 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bdcc7c6d-0472-46a1-b85d-619898b59f05 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:24.627537 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bdcc7c6d-0472-46a1-b85d-619898b59f05 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:24.628319 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bdcc7c6d-0472-46a1-b85d-619898b59f05 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:24.628752 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bdcc7c6d-0472-46a1-b85d-619898b59f05 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:24.766762 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-bdcc7c6d-0472-46a1-b85d-619898b59f05 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:24.774567 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-bdcc7c6d-0472-46a1-b85d-619898b59f05 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1567 microversion: 2.1 time: 0.159980 Nov 15 12:42:24.775162 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 221/414] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:24 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:42:25.371096 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-b4a44ba0-4f1c-4264-b514-fafb3fac3aa6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:25.371927 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-b4a44ba0-4f1c-4264-b514-fafb3fac3aa6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:25.378888 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b4a44ba0-4f1c-4264-b514-fafb3fac3aa6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:25.379526 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b4a44ba0-4f1c-4264-b514-fafb3fac3aa6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:25.380357 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b4a44ba0-4f1c-4264-b514-fafb3fac3aa6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:25.381528 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b4a44ba0-4f1c-4264-b514-fafb3fac3aa6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:25.522481 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-b4a44ba0-4f1c-4264-b514-fafb3fac3aa6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:25.531470 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-b4a44ba0-4f1c-4264-b514-fafb3fac3aa6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1723 microversion: 2.1 time: 0.163972 Nov 15 12:42:25.532056 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 222/415] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:25 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:42:25.536414 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-64b594bc-0e67-4a5b-892b-cd08c7b4c9a9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:25.537318 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-64b594bc-0e67-4a5b-892b-cd08c7b4c9a9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:25.543340 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-64b594bc-0e67-4a5b-892b-cd08c7b4c9a9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:25.543788 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-64b594bc-0e67-4a5b-892b-cd08c7b4c9a9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:25.544566 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-64b594bc-0e67-4a5b-892b-cd08c7b4c9a9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:25.545009 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-64b594bc-0e67-4a5b-892b-cd08c7b4c9a9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:25.669756 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-64b594bc-0e67-4a5b-892b-cd08c7b4c9a9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 28877 microversion: 2.20 time: 0.136446 Nov 15 12:42:25.670403 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 223/416] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:42:25 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 28877 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:42:25.792228 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-214c6568-aac8-4798-90fc-3994c1c4c2d4 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:25.792841 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-214c6568-aac8-4798-90fc-3994c1c4c2d4 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:25.799985 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-214c6568-aac8-4798-90fc-3994c1c4c2d4 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:25.800433 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-214c6568-aac8-4798-90fc-3994c1c4c2d4 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:25.801209 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-214c6568-aac8-4798-90fc-3994c1c4c2d4 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:25.801643 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-214c6568-aac8-4798-90fc-3994c1c4c2d4 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:25.952791 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.network.neutron [None req-3360296f-0325-4a6f-819b-51eb17553eee tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] validate_networks() for None {{(pid=122568) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 15 12:42:25.955625 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-214c6568-aac8-4798-90fc-3994c1c4c2d4 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:25.965920 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-214c6568-aac8-4798-90fc-3994c1c4c2d4 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1567 microversion: 2.1 time: 0.177004 Nov 15 12:42:25.967006 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 224/417] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:25 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:42:26.308335 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-3360296f-0325-4a6f-819b-51eb17553eee tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Flavor limits 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 15 12:42:26.308779 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-3360296f-0325-4a6f-819b-51eb17553eee tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Image limits 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 15 12:42:26.309218 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-3360296f-0325-4a6f-819b-51eb17553eee tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Flavor pref 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 15 12:42:26.309676 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-3360296f-0325-4a6f-819b-51eb17553eee tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Image pref 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 15 12:42:26.310164 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-3360296f-0325-4a6f-819b-51eb17553eee tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 15 12:42:26.319256 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3360296f-0325-4a6f-819b-51eb17553eee tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:26.319702 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3360296f-0325-4a6f-819b-51eb17553eee tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:26.320511 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3360296f-0325-4a6f-819b-51eb17553eee tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:26.320939 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3360296f-0325-4a6f-819b-51eb17553eee tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:26.338920 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-3360296f-0325-4a6f-819b-51eb17553eee tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Getting quotas for project 1b2957be7c6842c2b5ab55e4c5b80b61. Resources: {'cores', 'ram', 'instances'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:42:26.345209 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-3360296f-0325-4a6f-819b-51eb17553eee tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Getting quotas for user 89b8d6f474c84a7b8888c60b5fcf1750 and project 1b2957be7c6842c2b5ab55e4c5b80b61. Resources: {'cores', 'ram', 'instances'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:42:26.361698 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-3360296f-0325-4a6f-819b-51eb17553eee tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Going to run 1 instances... {{(pid=122568) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 15 12:42:26.364552 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-3360296f-0325-4a6f-819b-51eb17553eee tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] [instance: 4aa66639-fe9f-4d4a-be8d-72becd784196] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3cc21e2c-27da-4266-be76-369023341c16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 15 12:42:26.420660 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-3360296f-0325-4a6f-819b-51eb17553eee tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.846342 Nov 15 12:42:26.421674 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 194/418] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Nov 15 12:42:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 9848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 15 12:42:26.432498 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-0e6095b6-775f-4e41-b29b-6d76634891b6 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:26.433127 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-0e6095b6-775f-4e41-b29b-6d76634891b6 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] [instance: 4aa66639-fe9f-4d4a-be8d-72becd784196] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:26.502075 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-0e6095b6-775f-4e41-b29b-6d76634891b6 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8d6f474c84a7b8888c60b5fcf1750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2957be7c6842c2b5ab55e4c5b80b61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:26.509945 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-0e6095b6-775f-4e41-b29b-6d76634891b6 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] 10.222.0.43 "GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196" status: 200 len: 1215 microversion: 2.1 time: 0.082153 Nov 15 12:42:26.510517 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 225/419] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:26 2021] GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196 => generated 1215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:26.550390 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-e9274ac6-4670-4c4d-95c6-4162c494a411 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:26.551026 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-e9274ac6-4670-4c4d-95c6-4162c494a411 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:26.559698 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e9274ac6-4670-4c4d-95c6-4162c494a411 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:26.560160 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e9274ac6-4670-4c4d-95c6-4162c494a411 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:26.561016 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e9274ac6-4670-4c4d-95c6-4162c494a411 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:26.561446 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e9274ac6-4670-4c4d-95c6-4162c494a411 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:26.682716 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-7ec342c1-4ea9-4c44-9594-e37551cfd0ea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:26.684572 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-7ec342c1-4ea9-4c44-9594-e37551cfd0ea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:26.694138 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7ec342c1-4ea9-4c44-9594-e37551cfd0ea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:26.694928 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7ec342c1-4ea9-4c44-9594-e37551cfd0ea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:26.696238 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7ec342c1-4ea9-4c44-9594-e37551cfd0ea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:26.696950 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7ec342c1-4ea9-4c44-9594-e37551cfd0ea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:26.746016 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-e9274ac6-4670-4c4d-95c6-4162c494a411 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:26.756844 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-e9274ac6-4670-4c4d-95c6-4162c494a411 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1700 microversion: 2.1 time: 0.211670 Nov 15 12:42:26.757657 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 195/420] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:26 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1700 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:26.783294 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-50e491af-c5be-4c1d-953f-7b8b085e02eb tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:26.790726 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-50e491af-c5be-4c1d-953f-7b8b085e02eb tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:26.791245 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-50e491af-c5be-4c1d-953f-7b8b085e02eb tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:26.814720 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-50e491af-c5be-4c1d-953f-7b8b085e02eb tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Going to try to start instance {{(pid=122568) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 15 12:42:26.825539 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-7ec342c1-4ea9-4c44-9594-e37551cfd0ea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 30626 microversion: 2.20 time: 0.146603 Nov 15 12:42:26.826297 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 226/421] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:42:26 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 30626 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:42:26.860650 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-50e491af-c5be-4c1d-953f-7b8b085e02eb tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 202 len: 0 microversion: 2.1 time: 0.089320 Nov 15 12:42:26.861133 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 196/422] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:42:26 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:42:26.869676 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-b10cae43-8386-4b8a-a595-95e99c30e259 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:26.870373 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-b10cae43-8386-4b8a-a595-95e99c30e259 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:26.877344 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b10cae43-8386-4b8a-a595-95e99c30e259 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:26.877786 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b10cae43-8386-4b8a-a595-95e99c30e259 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:26.878574 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b10cae43-8386-4b8a-a595-95e99c30e259 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:26.879107 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b10cae43-8386-4b8a-a595-95e99c30e259 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:26.990845 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-e0d5cd82-5ff9-433a-ad84-4ae6e9866794 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:26.992124 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-e0d5cd82-5ff9-433a-ad84-4ae6e9866794 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:27.000354 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e0d5cd82-5ff9-433a-ad84-4ae6e9866794 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:27.000946 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e0d5cd82-5ff9-433a-ad84-4ae6e9866794 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:27.001835 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e0d5cd82-5ff9-433a-ad84-4ae6e9866794 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:27.002382 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e0d5cd82-5ff9-433a-ad84-4ae6e9866794 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:27.055813 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-b10cae43-8386-4b8a-a595-95e99c30e259 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:27.066378 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-b10cae43-8386-4b8a-a595-95e99c30e259 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1709 microversion: 2.1 time: 0.200613 Nov 15 12:42:27.066968 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 227/423] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:26 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1709 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:27.245454 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-e0d5cd82-5ff9-433a-ad84-4ae6e9866794 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:27.254288 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-e0d5cd82-5ff9-433a-ad84-4ae6e9866794 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1567 microversion: 2.1 time: 0.268469 Nov 15 12:42:27.254998 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 197/424] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:26 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1567 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:42:27.530383 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-176c2cf7-d983-4f11-aa2c-ab0005759f5b tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:27.531547 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-176c2cf7-d983-4f11-aa2c-ab0005759f5b tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] [instance: 4aa66639-fe9f-4d4a-be8d-72becd784196] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:27.537605 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-176c2cf7-d983-4f11-aa2c-ab0005759f5b tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:27.538046 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-176c2cf7-d983-4f11-aa2c-ab0005759f5b tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:27.539086 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-176c2cf7-d983-4f11-aa2c-ab0005759f5b tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:27.539509 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-176c2cf7-d983-4f11-aa2c-ab0005759f5b tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:27.605481 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-176c2cf7-d983-4f11-aa2c-ab0005759f5b tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8d6f474c84a7b8888c60b5fcf1750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2957be7c6842c2b5ab55e4c5b80b61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:27.613415 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-176c2cf7-d983-4f11-aa2c-ab0005759f5b tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] 10.222.0.43 "GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196" status: 200 len: 1267 microversion: 2.1 time: 0.089073 Nov 15 12:42:27.613948 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 228/425] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:27 2021] GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196 => generated 1267 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:27.837751 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-d4e3e370-a967-48d1-b79c-154ec0a0caf7 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:27.839372 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-d4e3e370-a967-48d1-b79c-154ec0a0caf7 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:27.847757 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d4e3e370-a967-48d1-b79c-154ec0a0caf7 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:27.848205 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d4e3e370-a967-48d1-b79c-154ec0a0caf7 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:27.849090 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d4e3e370-a967-48d1-b79c-154ec0a0caf7 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:27.849448 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d4e3e370-a967-48d1-b79c-154ec0a0caf7 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:27.996325 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-d4e3e370-a967-48d1-b79c-154ec0a0caf7 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 31754 microversion: 2.20 time: 0.162400 Nov 15 12:42:27.998094 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 198/426] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:42:27 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 31754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 15 12:42:28.083715 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-87d3bd74-203d-496c-8b09-54c7d7ce5269 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:28.084316 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-87d3bd74-203d-496c-8b09-54c7d7ce5269 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:28.091366 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-87d3bd74-203d-496c-8b09-54c7d7ce5269 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:28.091799 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-87d3bd74-203d-496c-8b09-54c7d7ce5269 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:28.092605 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-87d3bd74-203d-496c-8b09-54c7d7ce5269 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:28.093154 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-87d3bd74-203d-496c-8b09-54c7d7ce5269 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:28.234793 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-87d3bd74-203d-496c-8b09-54c7d7ce5269 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:28.242571 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-87d3bd74-203d-496c-8b09-54c7d7ce5269 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1709 microversion: 2.1 time: 0.162399 Nov 15 12:42:28.243186 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 229/427] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:28 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1709 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:28.271985 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-f9af090d-68d4-40ef-b468-d4059b2c75cf tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:28.272866 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-f9af090d-68d4-40ef-b468-d4059b2c75cf tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:28.280727 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f9af090d-68d4-40ef-b468-d4059b2c75cf tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:28.281168 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f9af090d-68d4-40ef-b468-d4059b2c75cf tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:28.282091 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f9af090d-68d4-40ef-b468-d4059b2c75cf tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:28.282719 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f9af090d-68d4-40ef-b468-d4059b2c75cf tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:28.440185 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-f9af090d-68d4-40ef-b468-d4059b2c75cf tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:28.448976 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-f9af090d-68d4-40ef-b468-d4059b2c75cf tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1567 microversion: 2.1 time: 0.180901 Nov 15 12:42:28.451485 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 199/428] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:28 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:28.631073 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-d107cb3b-687a-4417-94ad-fe6eb1a69038 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:28.631755 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-d107cb3b-687a-4417-94ad-fe6eb1a69038 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] [instance: 4aa66639-fe9f-4d4a-be8d-72becd784196] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:28.639538 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d107cb3b-687a-4417-94ad-fe6eb1a69038 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:28.639988 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d107cb3b-687a-4417-94ad-fe6eb1a69038 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:28.640774 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d107cb3b-687a-4417-94ad-fe6eb1a69038 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:28.641196 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d107cb3b-687a-4417-94ad-fe6eb1a69038 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:28.786551 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-d107cb3b-687a-4417-94ad-fe6eb1a69038 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8d6f474c84a7b8888c60b5fcf1750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2957be7c6842c2b5ab55e4c5b80b61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:28.794120 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-d107cb3b-687a-4417-94ad-fe6eb1a69038 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] 10.222.0.43 "GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196" status: 200 len: 1315 microversion: 2.1 time: 0.167631 Nov 15 12:42:28.794700 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 230/429] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:28 2021] GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:29.009342 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-01a5eda2-4efc-4a1e-89d3-a6c99cedf3fe tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:29.010244 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-01a5eda2-4efc-4a1e-89d3-a6c99cedf3fe tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:29.017303 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-01a5eda2-4efc-4a1e-89d3-a6c99cedf3fe tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:29.017735 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-01a5eda2-4efc-4a1e-89d3-a6c99cedf3fe tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:29.018502 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-01a5eda2-4efc-4a1e-89d3-a6c99cedf3fe tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:29.018952 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-01a5eda2-4efc-4a1e-89d3-a6c99cedf3fe tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:29.135150 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-01a5eda2-4efc-4a1e-89d3-a6c99cedf3fe tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 32110 microversion: 2.20 time: 0.129075 Nov 15 12:42:29.136400 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 200/430] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:42:29 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 32110 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:42:29.259861 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-b9a4c296-5e1b-40c3-9fe1-cd16942de951 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:29.260769 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-b9a4c296-5e1b-40c3-9fe1-cd16942de951 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:29.267293 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b9a4c296-5e1b-40c3-9fe1-cd16942de951 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:29.271165 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b9a4c296-5e1b-40c3-9fe1-cd16942de951 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:29.272066 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b9a4c296-5e1b-40c3-9fe1-cd16942de951 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:29.272500 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b9a4c296-5e1b-40c3-9fe1-cd16942de951 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:29.366988 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-295c7674-db6a-427a-adb8-79306a6d066f req-ac2a4c37-0cd7-4563-9bd0-91fcf2ad2982 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aa66639-fe9f-4d4a-be8d-72becd784196", "tag": "b76c9762-9bbc-412c-a457-c5a1559ffe6b"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:29.369200 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:42:29.369200 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:42:29.379660 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-295c7674-db6a-427a-adb8-79306a6d066f req-ac2a4c37-0cd7-4563-9bd0-91fcf2ad2982 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:29.380456 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-295c7674-db6a-427a-adb8-79306a6d066f req-ac2a4c37-0cd7-4563-9bd0-91fcf2ad2982 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:29.398163 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-295c7674-db6a-427a-adb8-79306a6d066f req-ac2a4c37-0cd7-4563-9bd0-91fcf2ad2982 service nova] Creating event network-changed:b76c9762-9bbc-412c-a457-c5a1559ffe6b for instance 4aa66639-fe9f-4d4a-be8d-72becd784196 on hv-cinder-68088 Nov 15 12:42:29.403354 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-295c7674-db6a-427a-adb8-79306a6d066f req-ac2a4c37-0cd7-4563-9bd0-91fcf2ad2982 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041074 Nov 15 12:42:29.404065 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 201/431] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:42:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:42:29.452440 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-b9a4c296-5e1b-40c3-9fe1-cd16942de951 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:29.469048 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-d01c6bb7-a619-40e8-b517-9a6e1f0dbbf0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:29.475469 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-d01c6bb7-a619-40e8-b517-9a6e1f0dbbf0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:29.478673 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-b9a4c296-5e1b-40c3-9fe1-cd16942de951 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1713 microversion: 2.1 time: 0.222249 Nov 15 12:42:29.483203 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 231/432] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:29 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1713 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:29.486049 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d01c6bb7-a619-40e8-b517-9a6e1f0dbbf0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:29.486572 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d01c6bb7-a619-40e8-b517-9a6e1f0dbbf0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:29.487477 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d01c6bb7-a619-40e8-b517-9a6e1f0dbbf0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:29.488358 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d01c6bb7-a619-40e8-b517-9a6e1f0dbbf0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:29.650484 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-d01c6bb7-a619-40e8-b517-9a6e1f0dbbf0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:29.658659 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-d01c6bb7-a619-40e8-b517-9a6e1f0dbbf0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1567 microversion: 2.1 time: 0.194923 Nov 15 12:42:29.659263 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 202/433] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:29 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:29.811998 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-1812ceba-3103-4f63-83a1-58091020f439 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:29.812609 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-1812ceba-3103-4f63-83a1-58091020f439 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] [instance: 4aa66639-fe9f-4d4a-be8d-72becd784196] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:29.818962 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1812ceba-3103-4f63-83a1-58091020f439 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:29.819415 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1812ceba-3103-4f63-83a1-58091020f439 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:29.820195 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1812ceba-3103-4f63-83a1-58091020f439 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:29.820629 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1812ceba-3103-4f63-83a1-58091020f439 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:29.955909 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-1812ceba-3103-4f63-83a1-58091020f439 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8d6f474c84a7b8888c60b5fcf1750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2957be7c6842c2b5ab55e4c5b80b61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:29.963487 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-1812ceba-3103-4f63-83a1-58091020f439 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] 10.222.0.43 "GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196" status: 200 len: 1315 microversion: 2.1 time: 0.155546 Nov 15 12:42:29.964075 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 232/434] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:29 2021] GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:30.147989 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-e4538e1e-c466-4379-944e-ad2ec0d7f178 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:30.148922 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-e4538e1e-c466-4379-944e-ad2ec0d7f178 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:30.156004 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e4538e1e-c466-4379-944e-ad2ec0d7f178 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:30.156367 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e4538e1e-c466-4379-944e-ad2ec0d7f178 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:30.157135 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e4538e1e-c466-4379-944e-ad2ec0d7f178 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:30.157554 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e4538e1e-c466-4379-944e-ad2ec0d7f178 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:30.348722 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-e4538e1e-c466-4379-944e-ad2ec0d7f178 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 32785 microversion: 2.20 time: 0.204351 Nov 15 12:42:30.349366 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 203/435] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:42:30 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 32785 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 15 12:42:30.676559 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-2fef5a45-924d-423c-bd7b-7aa041edc736 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:30.677161 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-2fef5a45-924d-423c-bd7b-7aa041edc736 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:30.683092 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2fef5a45-924d-423c-bd7b-7aa041edc736 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:30.683543 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2fef5a45-924d-423c-bd7b-7aa041edc736 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:30.685164 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2fef5a45-924d-423c-bd7b-7aa041edc736 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:30.685594 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2fef5a45-924d-423c-bd7b-7aa041edc736 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:30.815327 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-2fef5a45-924d-423c-bd7b-7aa041edc736 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:30.823469 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-2fef5a45-924d-423c-bd7b-7aa041edc736 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1567 microversion: 2.1 time: 0.150945 Nov 15 12:42:30.824029 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 233/436] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:30 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:30.981548 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-04d755e7-62bc-4b83-b3e6-4b6009d70dc0 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:30.982235 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-04d755e7-62bc-4b83-b3e6-4b6009d70dc0 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] [instance: 4aa66639-fe9f-4d4a-be8d-72becd784196] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:30.989067 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-04d755e7-62bc-4b83-b3e6-4b6009d70dc0 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:30.989507 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-04d755e7-62bc-4b83-b3e6-4b6009d70dc0 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:30.990271 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-04d755e7-62bc-4b83-b3e6-4b6009d70dc0 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:30.990699 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-04d755e7-62bc-4b83-b3e6-4b6009d70dc0 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:31.128107 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-04d755e7-62bc-4b83-b3e6-4b6009d70dc0 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8d6f474c84a7b8888c60b5fcf1750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2957be7c6842c2b5ab55e4c5b80b61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:31.135651 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-04d755e7-62bc-4b83-b3e6-4b6009d70dc0 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] 10.222.0.43 "GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196" status: 200 len: 1315 microversion: 2.1 time: 0.158699 Nov 15 12:42:31.136225 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 204/437] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:30 2021] GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:31.361153 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-3fef4b9e-a62e-422a-8149-64110ccb56a5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:31.362170 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-3fef4b9e-a62e-422a-8149-64110ccb56a5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:31.368141 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3fef4b9e-a62e-422a-8149-64110ccb56a5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:31.368584 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3fef4b9e-a62e-422a-8149-64110ccb56a5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:31.369355 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3fef4b9e-a62e-422a-8149-64110ccb56a5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:31.369785 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3fef4b9e-a62e-422a-8149-64110ccb56a5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:31.482593 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-3fef4b9e-a62e-422a-8149-64110ccb56a5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 33373 microversion: 2.20 time: 0.125040 Nov 15 12:42:31.483277 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 234/438] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:42:31 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 33373 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:42:31.841606 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-357785a6-6a46-40a3-8695-268543b785e9 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:31.842208 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-357785a6-6a46-40a3-8695-268543b785e9 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:31.848616 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-357785a6-6a46-40a3-8695-268543b785e9 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:31.849088 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-357785a6-6a46-40a3-8695-268543b785e9 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:31.849866 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-357785a6-6a46-40a3-8695-268543b785e9 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:31.850296 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-357785a6-6a46-40a3-8695-268543b785e9 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:31.979793 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-357785a6-6a46-40a3-8695-268543b785e9 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:31.988911 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-357785a6-6a46-40a3-8695-268543b785e9 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1567 microversion: 2.1 time: 0.151890 Nov 15 12:42:31.989618 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 205/439] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:31 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:42:32.153886 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-a2a4e99e-b786-44bf-9fbe-8cfa74f02bdc tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:32.154586 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-a2a4e99e-b786-44bf-9fbe-8cfa74f02bdc tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] [instance: 4aa66639-fe9f-4d4a-be8d-72becd784196] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:32.161401 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a2a4e99e-b786-44bf-9fbe-8cfa74f02bdc tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:32.161840 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a2a4e99e-b786-44bf-9fbe-8cfa74f02bdc tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:32.162612 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a2a4e99e-b786-44bf-9fbe-8cfa74f02bdc tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:32.163098 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a2a4e99e-b786-44bf-9fbe-8cfa74f02bdc tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:32.300000 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-a2a4e99e-b786-44bf-9fbe-8cfa74f02bdc tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8d6f474c84a7b8888c60b5fcf1750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2957be7c6842c2b5ab55e4c5b80b61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:32.307408 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-a2a4e99e-b786-44bf-9fbe-8cfa74f02bdc tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] 10.222.0.43 "GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196" status: 200 len: 1315 microversion: 2.1 time: 0.158115 Nov 15 12:42:32.307975 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 235/440] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:32 2021] GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:32.494573 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-29dcae49-6228-4c36-9888-10095e64264f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:32.495511 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-29dcae49-6228-4c36-9888-10095e64264f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:32.502452 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-29dcae49-6228-4c36-9888-10095e64264f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:32.502919 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-29dcae49-6228-4c36-9888-10095e64264f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:32.503676 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-29dcae49-6228-4c36-9888-10095e64264f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:32.504096 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-29dcae49-6228-4c36-9888-10095e64264f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:32.620503 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-29dcae49-6228-4c36-9888-10095e64264f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 34142 microversion: 2.20 time: 0.129410 Nov 15 12:42:32.622069 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 206/441] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:42:32 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 34142 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:42:32.715482 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-23543bcf-c77a-4dc2-b09b-801c7c296a7d tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4e8a17c-f21b-4a4a-9666-05894f7e13de", "device": "/dev/sdb"}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:32.717056 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-23543bcf-c77a-4dc2-b09b-801c7c296a7d tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: d7de1403-72dd-46fd-b7a0-97e4d6c201d9] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:32.724895 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-23543bcf-c77a-4dc2-b09b-801c7c296a7d tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:32.725706 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-23543bcf-c77a-4dc2-b09b-801c7c296a7d tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:32.727177 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-23543bcf-c77a-4dc2-b09b-801c7c296a7d tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:32.728024 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-23543bcf-c77a-4dc2-b09b-801c7c296a7d tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:32.984333 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-23543bcf-c77a-4dc2-b09b-801c7c296a7d tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "POST /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272339 Nov 15 12:42:32.985124 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 236/442] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Nov 15 12:42:32 2021] POST /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:42:33.005953 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-7db228d9-d19b-41da-afad-b2885b6c8991 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:33.006871 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-7db228d9-d19b-41da-afad-b2885b6c8991 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:33.014334 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7db228d9-d19b-41da-afad-b2885b6c8991 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:33.014972 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7db228d9-d19b-41da-afad-b2885b6c8991 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:33.016162 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7db228d9-d19b-41da-afad-b2885b6c8991 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:33.016800 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7db228d9-d19b-41da-afad-b2885b6c8991 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:33.165596 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-7db228d9-d19b-41da-afad-b2885b6c8991 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:33.174928 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-7db228d9-d19b-41da-afad-b2885b6c8991 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1567 microversion: 2.1 time: 0.173120 Nov 15 12:42:33.175610 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 207/443] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:33 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:33.324708 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-89142e11-d9b1-4469-803f-4ccf5e067d87 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:33.325313 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-89142e11-d9b1-4469-803f-4ccf5e067d87 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] [instance: 4aa66639-fe9f-4d4a-be8d-72becd784196] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:33.331447 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-89142e11-d9b1-4469-803f-4ccf5e067d87 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:33.331923 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-89142e11-d9b1-4469-803f-4ccf5e067d87 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:33.332704 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-89142e11-d9b1-4469-803f-4ccf5e067d87 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:33.333271 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-89142e11-d9b1-4469-803f-4ccf5e067d87 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:33.469747 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-89142e11-d9b1-4469-803f-4ccf5e067d87 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8d6f474c84a7b8888c60b5fcf1750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2957be7c6842c2b5ab55e4c5b80b61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:33.477087 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-89142e11-d9b1-4469-803f-4ccf5e067d87 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] 10.222.0.43 "GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196" status: 200 len: 1315 microversion: 2.1 time: 0.156956 Nov 15 12:42:33.477648 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 237/444] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:33 2021] GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:33.635674 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-da1ca735-a170-4971-9845-7a12faf5c2dc tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:33.636594 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-da1ca735-a170-4971-9845-7a12faf5c2dc tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:33.643508 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-da1ca735-a170-4971-9845-7a12faf5c2dc tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:33.643945 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-da1ca735-a170-4971-9845-7a12faf5c2dc tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:33.644712 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-da1ca735-a170-4971-9845-7a12faf5c2dc tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:33.645133 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-da1ca735-a170-4971-9845-7a12faf5c2dc tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:33.760767 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-da1ca735-a170-4971-9845-7a12faf5c2dc tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 35037 microversion: 2.20 time: 0.128508 Nov 15 12:42:33.761953 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 208/445] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:42:33 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 35037 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:42:34.193326 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-7e3cdbee-009e-4eec-a861-d46fa0ad774e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:34.193951 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-7e3cdbee-009e-4eec-a861-d46fa0ad774e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:34.201732 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7e3cdbee-009e-4eec-a861-d46fa0ad774e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:34.202667 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7e3cdbee-009e-4eec-a861-d46fa0ad774e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:34.202999 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7e3cdbee-009e-4eec-a861-d46fa0ad774e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:34.203433 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7e3cdbee-009e-4eec-a861-d46fa0ad774e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:34.333393 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-7e3cdbee-009e-4eec-a861-d46fa0ad774e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:34.341596 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-7e3cdbee-009e-4eec-a861-d46fa0ad774e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1567 microversion: 2.1 time: 0.152552 Nov 15 12:42:34.342160 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 238/446] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:34 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:34.495884 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-e8dfcd74-6775-4fd4-95ed-864ab6468139 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:34.496630 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-e8dfcd74-6775-4fd4-95ed-864ab6468139 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] [instance: 4aa66639-fe9f-4d4a-be8d-72becd784196] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:34.503590 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e8dfcd74-6775-4fd4-95ed-864ab6468139 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:34.504032 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e8dfcd74-6775-4fd4-95ed-864ab6468139 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:34.504806 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e8dfcd74-6775-4fd4-95ed-864ab6468139 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:34.505249 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e8dfcd74-6775-4fd4-95ed-864ab6468139 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:34.641005 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-e8dfcd74-6775-4fd4-95ed-864ab6468139 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8d6f474c84a7b8888c60b5fcf1750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2957be7c6842c2b5ab55e4c5b80b61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:34.648319 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-e8dfcd74-6775-4fd4-95ed-864ab6468139 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] 10.222.0.43 "GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196" status: 200 len: 1315 microversion: 2.1 time: 0.156516 Nov 15 12:42:34.648875 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 209/447] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:34 2021] GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:34.772754 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-73e48d47-250c-4910-9380-ad4e9e2a6771 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:34.773756 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-73e48d47-250c-4910-9380-ad4e9e2a6771 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:34.781322 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-73e48d47-250c-4910-9380-ad4e9e2a6771 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:34.781771 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-73e48d47-250c-4910-9380-ad4e9e2a6771 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:34.782550 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-73e48d47-250c-4910-9380-ad4e9e2a6771 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:34.783017 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-73e48d47-250c-4910-9380-ad4e9e2a6771 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:34.903625 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-73e48d47-250c-4910-9380-ad4e9e2a6771 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 35698 microversion: 2.20 time: 0.134133 Nov 15 12:42:34.904528 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 239/448] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:42:34 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 35698 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:42:35.358951 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-ffdfcb9d-b20b-4fbd-a8d9-fdac3720e95e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:35.359559 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-ffdfcb9d-b20b-4fbd-a8d9-fdac3720e95e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:35.365955 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ffdfcb9d-b20b-4fbd-a8d9-fdac3720e95e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:35.366401 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ffdfcb9d-b20b-4fbd-a8d9-fdac3720e95e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:35.367213 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ffdfcb9d-b20b-4fbd-a8d9-fdac3720e95e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:35.367645 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ffdfcb9d-b20b-4fbd-a8d9-fdac3720e95e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:35.505324 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-ffdfcb9d-b20b-4fbd-a8d9-fdac3720e95e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:35.513787 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-ffdfcb9d-b20b-4fbd-a8d9-fdac3720e95e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1567 microversion: 2.1 time: 0.158889 Nov 15 12:42:35.514354 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 210/449] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:35 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:42:35.665716 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e4731ff0-0093-43e2-93fd-e893ef5fced9 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:35.666410 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e4731ff0-0093-43e2-93fd-e893ef5fced9 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] [instance: 4aa66639-fe9f-4d4a-be8d-72becd784196] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:35.674156 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e4731ff0-0093-43e2-93fd-e893ef5fced9 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:35.674682 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e4731ff0-0093-43e2-93fd-e893ef5fced9 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:35.675903 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e4731ff0-0093-43e2-93fd-e893ef5fced9 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:35.675903 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e4731ff0-0093-43e2-93fd-e893ef5fced9 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:35.813858 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e4731ff0-0093-43e2-93fd-e893ef5fced9 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8d6f474c84a7b8888c60b5fcf1750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2957be7c6842c2b5ab55e4c5b80b61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:35.822962 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e4731ff0-0093-43e2-93fd-e893ef5fced9 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] 10.222.0.43 "GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196" status: 200 len: 1315 microversion: 2.1 time: 0.161179 Nov 15 12:42:35.823555 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 240/450] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:35 2021] GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:35.915336 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-336ea186-282a-4538-8cb8-04824cd3e3dd tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:35.916239 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-336ea186-282a-4538-8cb8-04824cd3e3dd tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:35.923284 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-336ea186-282a-4538-8cb8-04824cd3e3dd tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:35.923731 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-336ea186-282a-4538-8cb8-04824cd3e3dd tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:35.924492 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-336ea186-282a-4538-8cb8-04824cd3e3dd tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:35.924921 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-336ea186-282a-4538-8cb8-04824cd3e3dd tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:36.115412 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-336ea186-282a-4538-8cb8-04824cd3e3dd tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 36636 microversion: 2.20 time: 0.203453 Nov 15 12:42:36.115975 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 211/451] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:42:35 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 36636 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:42:36.531203 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-56908787-1a60-4ff1-b4e0-eafec4d637e2 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:36.531820 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-56908787-1a60-4ff1-b4e0-eafec4d637e2 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:36.538212 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-56908787-1a60-4ff1-b4e0-eafec4d637e2 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:36.538665 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-56908787-1a60-4ff1-b4e0-eafec4d637e2 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:36.539480 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-56908787-1a60-4ff1-b4e0-eafec4d637e2 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:36.539917 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-56908787-1a60-4ff1-b4e0-eafec4d637e2 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:36.549029 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-a5cda347-977b-4637-b7a5-05fe7433ddb7 req-a7b1e9d5-7bf1-476e-9c5a-4bc4e63abccc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aa66639-fe9f-4d4a-be8d-72becd784196", "name": "network-vif-plugged", "status": "completed", "tag": "b76c9762-9bbc-412c-a457-c5a1559ffe6b"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:36.551046 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:42:36.551046 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:42:36.560133 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-a5cda347-977b-4637-b7a5-05fe7433ddb7 req-a7b1e9d5-7bf1-476e-9c5a-4bc4e63abccc service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:36.560845 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-a5cda347-977b-4637-b7a5-05fe7433ddb7 req-a7b1e9d5-7bf1-476e-9c5a-4bc4e63abccc service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:36.572355 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-a5cda347-977b-4637-b7a5-05fe7433ddb7 req-a7b1e9d5-7bf1-476e-9c5a-4bc4e63abccc service nova] Creating event network-vif-plugged:b76c9762-9bbc-412c-a457-c5a1559ffe6b for instance 4aa66639-fe9f-4d4a-be8d-72becd784196 on hv-cinder-68088 Nov 15 12:42:36.577800 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-a5cda347-977b-4637-b7a5-05fe7433ddb7 req-a7b1e9d5-7bf1-476e-9c5a-4bc4e63abccc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033119 Nov 15 12:42:36.588408 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 212/452] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:42:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 15 12:42:36.713705 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-56908787-1a60-4ff1-b4e0-eafec4d637e2 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:36.723233 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-56908787-1a60-4ff1-b4e0-eafec4d637e2 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1567 microversion: 2.1 time: 0.195992 Nov 15 12:42:36.724127 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 241/453] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:36 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1567 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:36.815550 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-c25f804d-623b-4df3-9df7-8e667941da95 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1331361498", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1893789649", "security_groups": [{"name": "tempest-secgroup-smoke-429662263"}], "networks": [{"uuid": "a5b87d23-3bbf-4595-9263-f13da952980e"}], "block_device_mapping_v2": [{"uuid": "1f115027-5576-47fc-bcd0-40acf848e36a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:36.841866 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-83fda614-223f-459f-9642-2f38989dd475 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:36.843307 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-83fda614-223f-459f-9642-2f38989dd475 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] [instance: 4aa66639-fe9f-4d4a-be8d-72becd784196] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:36.850974 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-83fda614-223f-459f-9642-2f38989dd475 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:36.851418 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-83fda614-223f-459f-9642-2f38989dd475 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:36.852199 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-83fda614-223f-459f-9642-2f38989dd475 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:36.852627 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-83fda614-223f-459f-9642-2f38989dd475 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:36.970299 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.network.neutron [None req-c25f804d-623b-4df3-9df7-8e667941da95 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] validate_networks() for [('a5b87d23-3bbf-4595-9263-f13da952980e', None, None, None, None, None)] {{(pid=122568) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 15 12:42:37.070971 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-83fda614-223f-459f-9642-2f38989dd475 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8d6f474c84a7b8888c60b5fcf1750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2957be7c6842c2b5ab55e4c5b80b61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:37.078749 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-83fda614-223f-459f-9642-2f38989dd475 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] 10.222.0.43 "GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196" status: 200 len: 1315 microversion: 2.1 time: 0.242051 Nov 15 12:42:37.079342 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 242/454] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:36 2021] GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:42:37.129150 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-789f9ed3-2d0f-4437-b757-0c2ea9afd80f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:37.130050 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-789f9ed3-2d0f-4437-b757-0c2ea9afd80f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:37.136035 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-789f9ed3-2d0f-4437-b757-0c2ea9afd80f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:37.136476 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-789f9ed3-2d0f-4437-b757-0c2ea9afd80f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:37.141106 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-789f9ed3-2d0f-4437-b757-0c2ea9afd80f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:37.141106 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-789f9ed3-2d0f-4437-b757-0c2ea9afd80f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:37.346096 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-789f9ed3-2d0f-4437-b757-0c2ea9afd80f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 37407 microversion: 2.20 time: 0.220495 Nov 15 12:42:37.347578 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 243/455] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:42:37 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 37407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 15 12:42:37.378050 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-c25f804d-623b-4df3-9df7-8e667941da95 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Flavor limits 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 15 12:42:37.378503 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-c25f804d-623b-4df3-9df7-8e667941da95 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Image limits 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 15 12:42:37.379002 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-c25f804d-623b-4df3-9df7-8e667941da95 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Flavor pref 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 15 12:42:37.379397 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-c25f804d-623b-4df3-9df7-8e667941da95 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Image pref 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 15 12:42:37.379797 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-c25f804d-623b-4df3-9df7-8e667941da95 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 15 12:42:37.389725 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c25f804d-623b-4df3-9df7-8e667941da95 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:37.390168 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c25f804d-623b-4df3-9df7-8e667941da95 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:37.391021 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c25f804d-623b-4df3-9df7-8e667941da95 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:37.391451 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c25f804d-623b-4df3-9df7-8e667941da95 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:37.407720 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-c25f804d-623b-4df3-9df7-8e667941da95 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Getting quotas for project e7191bcfe4454fd9b47db87e8aa6e497. Resources: {'cores', 'ram', 'instances'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:42:37.411738 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-c25f804d-623b-4df3-9df7-8e667941da95 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Getting quotas for user ba0fb21696184f6ea168fa860bf7d427 and project e7191bcfe4454fd9b47db87e8aa6e497. Resources: {'cores', 'ram', 'instances'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:42:37.468957 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-c25f804d-623b-4df3-9df7-8e667941da95 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Going to run 1 instances... {{(pid=122568) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 15 12:42:37.471912 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-c25f804d-623b-4df3-9df7-8e667941da95 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1f115027-5576-47fc-bcd0-40acf848e36a',volume_size=None,volume_type=None)] {{(pid=122568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 15 12:42:37.597885 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-c25f804d-623b-4df3-9df7-8e667941da95 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.786247 Nov 15 12:42:37.598593 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 213/456] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Nov 15 12:42:36 2021] POST /compute/v2.1/servers => generated 405 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 15 12:42:37.609466 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-07b4fa8f-ec16-480a-849f-07a2b06ef69e tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:37.610170 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-07b4fa8f-ec16-480a-849f-07a2b06ef69e tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:37.671729 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-07b4fa8f-ec16-480a-849f-07a2b06ef69e tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:37.678532 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-07b4fa8f-ec16-480a-849f-07a2b06ef69e tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1089 microversion: 2.1 time: 0.073721 Nov 15 12:42:37.679130 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 244/457] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:37 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1089 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:37.741957 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-427725f2-81ec-426d-a5b7-10d55e1f40fd tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:37.742561 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-427725f2-81ec-426d-a5b7-10d55e1f40fd tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:37.749383 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-427725f2-81ec-426d-a5b7-10d55e1f40fd tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:37.749826 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-427725f2-81ec-426d-a5b7-10d55e1f40fd tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:37.750727 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-427725f2-81ec-426d-a5b7-10d55e1f40fd tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:37.751464 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-427725f2-81ec-426d-a5b7-10d55e1f40fd tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:37.903900 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-427725f2-81ec-426d-a5b7-10d55e1f40fd tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:37.912418 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-427725f2-81ec-426d-a5b7-10d55e1f40fd tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1567 microversion: 2.1 time: 0.174111 Nov 15 12:42:37.913003 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 214/458] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:37 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:38.095123 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-730a19e7-e478-4906-a9bb-5ad3bb692f8f tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:38.095712 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-730a19e7-e478-4906-a9bb-5ad3bb692f8f tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] [instance: 4aa66639-fe9f-4d4a-be8d-72becd784196] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:38.103558 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-730a19e7-e478-4906-a9bb-5ad3bb692f8f tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:38.104164 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-730a19e7-e478-4906-a9bb-5ad3bb692f8f tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:38.105148 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-730a19e7-e478-4906-a9bb-5ad3bb692f8f tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:38.105463 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-730a19e7-e478-4906-a9bb-5ad3bb692f8f tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:38.243779 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-730a19e7-e478-4906-a9bb-5ad3bb692f8f tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8d6f474c84a7b8888c60b5fcf1750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2957be7c6842c2b5ab55e4c5b80b61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:38.251859 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-730a19e7-e478-4906-a9bb-5ad3bb692f8f tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] 10.222.0.43 "GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196" status: 200 len: 1315 microversion: 2.1 time: 0.160329 Nov 15 12:42:38.252441 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 245/459] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:38 2021] GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:38.357508 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-1369b953-ff84-4c6b-9713-1002e08c3f38 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:38.358477 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-1369b953-ff84-4c6b-9713-1002e08c3f38 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:38.364641 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1369b953-ff84-4c6b-9713-1002e08c3f38 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:38.365075 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1369b953-ff84-4c6b-9713-1002e08c3f38 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:38.365898 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1369b953-ff84-4c6b-9713-1002e08c3f38 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:38.366322 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1369b953-ff84-4c6b-9713-1002e08c3f38 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:38.594843 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-1369b953-ff84-4c6b-9713-1002e08c3f38 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 38131 microversion: 2.20 time: 0.240708 Nov 15 12:42:38.595435 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 215/460] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:42:38 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 38131 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 15 12:42:38.696172 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-9d42cae5-553a-42ab-86e8-4442a1ae8008 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:38.696779 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-9d42cae5-553a-42ab-86e8-4442a1ae8008 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:38.704506 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9d42cae5-553a-42ab-86e8-4442a1ae8008 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:38.704950 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9d42cae5-553a-42ab-86e8-4442a1ae8008 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:38.705766 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9d42cae5-553a-42ab-86e8-4442a1ae8008 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:38.706199 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9d42cae5-553a-42ab-86e8-4442a1ae8008 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:38.769928 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-9d42cae5-553a-42ab-86e8-4442a1ae8008 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:38.778034 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-9d42cae5-553a-42ab-86e8-4442a1ae8008 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1187 microversion: 2.1 time: 0.085149 Nov 15 12:42:38.778034 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 246/461] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:38 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1187 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:38.932063 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-e4516242-9ffb-46a2-895d-4abc1e93e95c tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:38.932737 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-e4516242-9ffb-46a2-895d-4abc1e93e95c tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:38.939645 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e4516242-9ffb-46a2-895d-4abc1e93e95c tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:38.940078 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e4516242-9ffb-46a2-895d-4abc1e93e95c tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:38.940833 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e4516242-9ffb-46a2-895d-4abc1e93e95c tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:38.941255 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e4516242-9ffb-46a2-895d-4abc1e93e95c tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:39.081837 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-e4516242-9ffb-46a2-895d-4abc1e93e95c tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:39.089777 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-e4516242-9ffb-46a2-895d-4abc1e93e95c tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1567 microversion: 2.1 time: 0.161799 Nov 15 12:42:39.090983 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 216/462] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:38 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:39.268657 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-0334cf82-1402-4f69-a7c1-6a868c597594 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:39.269268 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-0334cf82-1402-4f69-a7c1-6a868c597594 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] [instance: 4aa66639-fe9f-4d4a-be8d-72becd784196] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:39.275520 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0334cf82-1402-4f69-a7c1-6a868c597594 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:39.275975 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0334cf82-1402-4f69-a7c1-6a868c597594 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:39.276759 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0334cf82-1402-4f69-a7c1-6a868c597594 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:39.277347 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0334cf82-1402-4f69-a7c1-6a868c597594 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:39.415168 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-0334cf82-1402-4f69-a7c1-6a868c597594 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8d6f474c84a7b8888c60b5fcf1750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2957be7c6842c2b5ab55e4c5b80b61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:39.423537 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-0334cf82-1402-4f69-a7c1-6a868c597594 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] 10.222.0.43 "GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196" status: 200 len: 1464 microversion: 2.1 time: 0.158346 Nov 15 12:42:39.424393 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 247/463] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:39 2021] GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196 => generated 1464 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:39.463452 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-e0e7d4fc-759c-4619-8f8b-7b13472b3377 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:39.463945 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-e0e7d4fc-759c-4619-8f8b-7b13472b3377 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] [instance: 4aa66639-fe9f-4d4a-be8d-72becd784196] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:39.470559 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e0e7d4fc-759c-4619-8f8b-7b13472b3377 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:39.471045 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e0e7d4fc-759c-4619-8f8b-7b13472b3377 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:39.471828 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e0e7d4fc-759c-4619-8f8b-7b13472b3377 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:39.472253 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e0e7d4fc-759c-4619-8f8b-7b13472b3377 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:39.500330 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-e0e7d4fc-759c-4619-8f8b-7b13472b3377 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] [instance: 4aa66639-fe9f-4d4a-be8d-72becd784196] Going to try to terminate instance {{(pid=122568) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 15 12:42:39.588827 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-e0e7d4fc-759c-4619-8f8b-7b13472b3377 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196" status: 204 len: 0 microversion: 2.1 time: 0.128814 Nov 15 12:42:39.589423 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 217/464] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Nov 15 12:42:39 2021] DELETE /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 15 12:42:39.598076 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-4708b6d6-4a4e-4ec7-a97a-a14d193c9c9d tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:39.598695 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-4708b6d6-4a4e-4ec7-a97a-a14d193c9c9d tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] [instance: 4aa66639-fe9f-4d4a-be8d-72becd784196] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:39.605375 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4708b6d6-4a4e-4ec7-a97a-a14d193c9c9d tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:39.607098 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4708b6d6-4a4e-4ec7-a97a-a14d193c9c9d tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:39.607611 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-3ebd6f6e-0599-4f18-a98c-49c99fcf18cb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:39.608217 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4708b6d6-4a4e-4ec7-a97a-a14d193c9c9d tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:39.608630 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-3ebd6f6e-0599-4f18-a98c-49c99fcf18cb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:39.608742 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4708b6d6-4a4e-4ec7-a97a-a14d193c9c9d tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:39.616500 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3ebd6f6e-0599-4f18-a98c-49c99fcf18cb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:39.616942 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3ebd6f6e-0599-4f18-a98c-49c99fcf18cb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:39.617776 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3ebd6f6e-0599-4f18-a98c-49c99fcf18cb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:39.618207 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3ebd6f6e-0599-4f18-a98c-49c99fcf18cb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:39.751764 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-4708b6d6-4a4e-4ec7-a97a-a14d193c9c9d tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8d6f474c84a7b8888c60b5fcf1750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2957be7c6842c2b5ab55e4c5b80b61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:39.759225 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-4708b6d6-4a4e-4ec7-a97a-a14d193c9c9d tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] 10.222.0.43 "GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196" status: 200 len: 1470 microversion: 2.1 time: 0.164814 Nov 15 12:42:39.759798 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 248/465] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:39 2021] GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196 => generated 1470 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:42:39.784331 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-3ebd6f6e-0599-4f18-a98c-49c99fcf18cb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 38240 microversion: 2.20 time: 0.181373 Nov 15 12:42:39.785037 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 218/466] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:42:39 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 38240 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:42:39.796287 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-25cdaa11-12ae-4432-bc13-293e88eafd45 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:39.796928 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-25cdaa11-12ae-4432-bc13-293e88eafd45 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:39.804202 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-25cdaa11-12ae-4432-bc13-293e88eafd45 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:39.804803 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-25cdaa11-12ae-4432-bc13-293e88eafd45 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:39.805666 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-25cdaa11-12ae-4432-bc13-293e88eafd45 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:39.806199 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-25cdaa11-12ae-4432-bc13-293e88eafd45 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:39.874194 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-25cdaa11-12ae-4432-bc13-293e88eafd45 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:39.881748 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-25cdaa11-12ae-4432-bc13-293e88eafd45 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1205 microversion: 2.1 time: 0.090173 Nov 15 12:42:39.882319 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 249/467] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:39 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1205 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:40.108626 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-8b2ab973-847a-4142-9c28-cfd2b4b49761 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:40.110257 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-8b2ab973-847a-4142-9c28-cfd2b4b49761 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:40.119151 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8b2ab973-847a-4142-9c28-cfd2b4b49761 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:40.119725 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8b2ab973-847a-4142-9c28-cfd2b4b49761 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:40.120754 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8b2ab973-847a-4142-9c28-cfd2b4b49761 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:40.121854 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8b2ab973-847a-4142-9c28-cfd2b4b49761 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:40.316821 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-8b2ab973-847a-4142-9c28-cfd2b4b49761 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:40.327362 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-8b2ab973-847a-4142-9c28-cfd2b4b49761 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1567 microversion: 2.1 time: 0.223666 Nov 15 12:42:40.328213 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 219/468] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:40 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1567 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:40.777035 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-40b9716c-4431-45fa-babd-f44a621cb6c4 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:40.778423 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-40b9716c-4431-45fa-babd-f44a621cb6c4 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] [instance: 4aa66639-fe9f-4d4a-be8d-72becd784196] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:40.784736 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-40b9716c-4431-45fa-babd-f44a621cb6c4 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:40.785185 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-40b9716c-4431-45fa-babd-f44a621cb6c4 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:40.785973 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-40b9716c-4431-45fa-babd-f44a621cb6c4 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:40.786412 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-40b9716c-4431-45fa-babd-f44a621cb6c4 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:40.797271 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-a131512b-53bd-4414-b3c6-8a5228ada953 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:40.799188 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-a131512b-53bd-4414-b3c6-8a5228ada953 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:40.806136 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a131512b-53bd-4414-b3c6-8a5228ada953 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:40.807254 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a131512b-53bd-4414-b3c6-8a5228ada953 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:40.808489 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a131512b-53bd-4414-b3c6-8a5228ada953 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:40.810597 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a131512b-53bd-4414-b3c6-8a5228ada953 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:40.976657 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-40b9716c-4431-45fa-babd-f44a621cb6c4 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8d6f474c84a7b8888c60b5fcf1750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2957be7c6842c2b5ab55e4c5b80b61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:40.985894 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-40b9716c-4431-45fa-babd-f44a621cb6c4 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] 10.222.0.43 "GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196" status: 200 len: 1470 microversion: 2.1 time: 0.212465 Nov 15 12:42:40.995885 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 250/469] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:40 2021] GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196 => generated 1470 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:40.996088 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-a131512b-53bd-4414-b3c6-8a5228ada953 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 200 len: 38310 microversion: 2.20 time: 0.197562 Nov 15 12:42:40.996217 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [req-dca82ee2-7974-46a2-8fc1-3df2783ae0bb req-e955e51e-c3b9-4a59-9424-c931b90ed116 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a56962f0-d8f9-4778-a21e-1f2bc81789fe", "tag": "5e3438d8-9d94-405a-af06-a2bd0727491d"}]} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:40.996325 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 220/470] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:42:40 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 38310 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 15 12:42:40.996409 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:42:40.996409 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: warnings.warn(msg) Nov 15 12:42:40.998514 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-c6695c93-f4c6-4a57-9fb3-bf311d342fa6 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:40.999308 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-c6695c93-f4c6-4a57-9fb3-bf311d342fa6 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:41.000401 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-dca82ee2-7974-46a2-8fc1-3df2783ae0bb req-e955e51e-c3b9-4a59-9424-c931b90ed116 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:41.001020 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-dca82ee2-7974-46a2-8fc1-3df2783ae0bb req-e955e51e-c3b9-4a59-9424-c931b90ed116 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:41.007542 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c6695c93-f4c6-4a57-9fb3-bf311d342fa6 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:41.008082 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c6695c93-f4c6-4a57-9fb3-bf311d342fa6 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:41.009598 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c6695c93-f4c6-4a57-9fb3-bf311d342fa6 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:41.010289 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c6695c93-f4c6-4a57-9fb3-bf311d342fa6 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:41.013885 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.compute.server_external_events [req-dca82ee2-7974-46a2-8fc1-3df2783ae0bb req-e955e51e-c3b9-4a59-9424-c931b90ed116 service nova] Creating event network-changed:5e3438d8-9d94-405a-af06-a2bd0727491d for instance a56962f0-d8f9-4778-a21e-1f2bc81789fe on hv-cinder-68088 Nov 15 12:42:41.017480 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [req-dca82ee2-7974-46a2-8fc1-3df2783ae0bb req-e955e51e-c3b9-4a59-9424-c931b90ed116 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029548 Nov 15 12:42:41.018389 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 251/471] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:42:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:42:41.025064 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-53165ec9-3c48-446f-afa1-ad0e2943f828 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:41.025589 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-53165ec9-3c48-446f-afa1-ad0e2943f828 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:41.037202 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-53165ec9-3c48-446f-afa1-ad0e2943f828 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:41.039148 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-53165ec9-3c48-446f-afa1-ad0e2943f828 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:41.040405 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-53165ec9-3c48-446f-afa1-ad0e2943f828 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:41.040924 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-53165ec9-3c48-446f-afa1-ad0e2943f828 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:41.079253 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-53165ec9-3c48-446f-afa1-ad0e2943f828 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/ips" status: 200 len: 153 microversion: 2.20 time: 0.059411 Nov 15 12:42:41.079996 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 252/472] 10.222.0.43 () {60 vars in 1288 bytes} [Mon Nov 15 12:42:41 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/ips => generated 153 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:42:41.173017 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-c6695c93-f4c6-4a57-9fb3-bf311d342fa6 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:41.180976 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-c6695c93-f4c6-4a57-9fb3-bf311d342fa6 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1272 microversion: 2.1 time: 0.186805 Nov 15 12:42:41.181562 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 221/473] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:40 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1272 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:41.345474 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-38dca9c5-3845-4c5e-8e30-b85fb4eb96e3 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:41.346080 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-38dca9c5-3845-4c5e-8e30-b85fb4eb96e3 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:41.353666 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-38dca9c5-3845-4c5e-8e30-b85fb4eb96e3 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:41.353666 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-38dca9c5-3845-4c5e-8e30-b85fb4eb96e3 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:41.354066 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-38dca9c5-3845-4c5e-8e30-b85fb4eb96e3 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:41.354532 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-38dca9c5-3845-4c5e-8e30-b85fb4eb96e3 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:41.491081 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-38dca9c5-3845-4c5e-8e30-b85fb4eb96e3 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:41.500307 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-38dca9c5-3845-4c5e-8e30-b85fb4eb96e3 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1567 microversion: 2.1 time: 0.158971 Nov 15 12:42:41.500876 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 253/474] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:41 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:42.003449 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-21321b2f-0f56-40ee-a351-8aa0e51376d9 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:42.003960 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-21321b2f-0f56-40ee-a351-8aa0e51376d9 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] [instance: 4aa66639-fe9f-4d4a-be8d-72becd784196] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:42.010209 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-21321b2f-0f56-40ee-a351-8aa0e51376d9 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:42.010641 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-21321b2f-0f56-40ee-a351-8aa0e51376d9 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:42.011484 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-21321b2f-0f56-40ee-a351-8aa0e51376d9 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:42.011963 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-21321b2f-0f56-40ee-a351-8aa0e51376d9 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:42.140236 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-21321b2f-0f56-40ee-a351-8aa0e51376d9 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8d6f474c84a7b8888c60b5fcf1750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2957be7c6842c2b5ab55e4c5b80b61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:42.147889 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-21321b2f-0f56-40ee-a351-8aa0e51376d9 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] 10.222.0.43 "GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196" status: 200 len: 1470 microversion: 2.1 time: 0.148222 Nov 15 12:42:42.148458 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 222/475] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:41 2021] GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196 => generated 1470 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:42.201116 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-22cf9000-1145-4595-be69-e46de6b57d1d tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:42.201751 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-22cf9000-1145-4595-be69-e46de6b57d1d tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:42.208122 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-22cf9000-1145-4595-be69-e46de6b57d1d tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:42.208569 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-22cf9000-1145-4595-be69-e46de6b57d1d tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:42.209356 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-22cf9000-1145-4595-be69-e46de6b57d1d tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:42.209786 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-22cf9000-1145-4595-be69-e46de6b57d1d tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:42.343728 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-22cf9000-1145-4595-be69-e46de6b57d1d tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:42.350932 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-22cf9000-1145-4595-be69-e46de6b57d1d tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1272 microversion: 2.1 time: 0.154027 Nov 15 12:42:42.351498 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 254/476] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:42 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1272 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:42.517205 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-4215406f-e0a5-429d-88a2-59fac7a18016 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:42.517804 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-4215406f-e0a5-429d-88a2-59fac7a18016 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:42.524227 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4215406f-e0a5-429d-88a2-59fac7a18016 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:42.524668 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4215406f-e0a5-429d-88a2-59fac7a18016 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:42.525439 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4215406f-e0a5-429d-88a2-59fac7a18016 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:42.525870 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4215406f-e0a5-429d-88a2-59fac7a18016 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:42.660671 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-4215406f-e0a5-429d-88a2-59fac7a18016 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:42.669268 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-4215406f-e0a5-429d-88a2-59fac7a18016 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1567 microversion: 2.1 time: 0.155574 Nov 15 12:42:42.669840 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 223/477] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:42 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:43.165297 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-2a863d4b-a510-47e8-b146-2dcddabf78d4 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:43.165896 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-2a863d4b-a510-47e8-b146-2dcddabf78d4 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] [instance: 4aa66639-fe9f-4d4a-be8d-72becd784196] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:43.172968 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2a863d4b-a510-47e8-b146-2dcddabf78d4 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:43.173470 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2a863d4b-a510-47e8-b146-2dcddabf78d4 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:43.174247 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2a863d4b-a510-47e8-b146-2dcddabf78d4 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:43.174705 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2a863d4b-a510-47e8-b146-2dcddabf78d4 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:43.312187 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-2a863d4b-a510-47e8-b146-2dcddabf78d4 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8d6f474c84a7b8888c60b5fcf1750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2957be7c6842c2b5ab55e4c5b80b61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:43.319672 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-2a863d4b-a510-47e8-b146-2dcddabf78d4 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] 10.222.0.43 "GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196" status: 200 len: 1470 microversion: 2.1 time: 0.158312 Nov 15 12:42:43.320254 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 255/478] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:43 2021] GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196 => generated 1470 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:42:43.368557 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-ea7a8bc0-5fdc-49a5-b442-6a2634603650 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:43.369146 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-ea7a8bc0-5fdc-49a5-b442-6a2634603650 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:43.376031 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ea7a8bc0-5fdc-49a5-b442-6a2634603650 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:43.376463 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ea7a8bc0-5fdc-49a5-b442-6a2634603650 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:43.377253 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ea7a8bc0-5fdc-49a5-b442-6a2634603650 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:43.377678 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ea7a8bc0-5fdc-49a5-b442-6a2634603650 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:43.514304 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-ea7a8bc0-5fdc-49a5-b442-6a2634603650 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:43.522097 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-ea7a8bc0-5fdc-49a5-b442-6a2634603650 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1272 microversion: 2.1 time: 0.157235 Nov 15 12:42:43.522716 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 224/479] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:43 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:43.686870 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-b716b5bc-5adc-4cd9-8805-d140e35dcdc7 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:43.687599 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-b716b5bc-5adc-4cd9-8805-d140e35dcdc7 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:43.693384 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b716b5bc-5adc-4cd9-8805-d140e35dcdc7 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:43.693874 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b716b5bc-5adc-4cd9-8805-d140e35dcdc7 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:43.694599 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b716b5bc-5adc-4cd9-8805-d140e35dcdc7 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:43.695073 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b716b5bc-5adc-4cd9-8805-d140e35dcdc7 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:43.835949 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-b716b5bc-5adc-4cd9-8805-d140e35dcdc7 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:43.843849 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-b716b5bc-5adc-4cd9-8805-d140e35dcdc7 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1567 microversion: 2.1 time: 0.161087 Nov 15 12:42:43.844410 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 256/480] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:43 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:44.337803 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-e50ab7c5-39c0-4bf8-aabb-270baffababc tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:44.338307 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-e50ab7c5-39c0-4bf8-aabb-270baffababc tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] [instance: 4aa66639-fe9f-4d4a-be8d-72becd784196] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:44.345411 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e50ab7c5-39c0-4bf8-aabb-270baffababc tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:44.345853 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e50ab7c5-39c0-4bf8-aabb-270baffababc tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:44.346616 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e50ab7c5-39c0-4bf8-aabb-270baffababc tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:44.347072 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e50ab7c5-39c0-4bf8-aabb-270baffababc tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:44.486252 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-e50ab7c5-39c0-4bf8-aabb-270baffababc tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8d6f474c84a7b8888c60b5fcf1750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2957be7c6842c2b5ab55e4c5b80b61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:44.493841 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-e50ab7c5-39c0-4bf8-aabb-270baffababc tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] 10.222.0.43 "GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196" status: 200 len: 1470 microversion: 2.1 time: 0.159737 Nov 15 12:42:44.494413 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 225/481] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:44 2021] GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196 => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:44.539059 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-b0ffb9df-360c-4192-9bc4-8b1cf5687e7d tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:44.539684 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-b0ffb9df-360c-4192-9bc4-8b1cf5687e7d tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:44.547116 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b0ffb9df-360c-4192-9bc4-8b1cf5687e7d tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:44.547565 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b0ffb9df-360c-4192-9bc4-8b1cf5687e7d tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:44.548632 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b0ffb9df-360c-4192-9bc4-8b1cf5687e7d tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:44.549064 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b0ffb9df-360c-4192-9bc4-8b1cf5687e7d tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:44.763253 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-b0ffb9df-360c-4192-9bc4-8b1cf5687e7d tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:44.773497 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-b0ffb9df-360c-4192-9bc4-8b1cf5687e7d tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1260 microversion: 2.1 time: 0.237856 Nov 15 12:42:44.774731 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 257/482] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:44 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1260 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:44.861474 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-c5845634-68d7-4151-a44b-725fbdd68736 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:44.863039 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-c5845634-68d7-4151-a44b-725fbdd68736 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:44.869415 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c5845634-68d7-4151-a44b-725fbdd68736 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:44.870153 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c5845634-68d7-4151-a44b-725fbdd68736 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:44.871420 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c5845634-68d7-4151-a44b-725fbdd68736 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:44.872069 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c5845634-68d7-4151-a44b-725fbdd68736 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:45.107155 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-c5845634-68d7-4151-a44b-725fbdd68736 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:45.115208 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-c5845634-68d7-4151-a44b-725fbdd68736 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1567 microversion: 2.1 time: 0.257463 Nov 15 12:42:45.115781 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 226/483] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:44 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1567 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:45.475477 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [req-bd61b732-388e-4273-875f-9ad1f9165fbc req-45db13d5-2cb4-4fc3-b28f-6debf0934112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aa66639-fe9f-4d4a-be8d-72becd784196", "name": "network-vif-deleted", "tag": "b76c9762-9bbc-412c-a457-c5a1559ffe6b"}]} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:45.477076 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:42:45.477076 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: warnings.warn(msg) Nov 15 12:42:45.485401 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-bd61b732-388e-4273-875f-9ad1f9165fbc req-45db13d5-2cb4-4fc3-b28f-6debf0934112 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:45.485841 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-bd61b732-388e-4273-875f-9ad1f9165fbc req-45db13d5-2cb4-4fc3-b28f-6debf0934112 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:45.498659 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.compute.server_external_events [req-bd61b732-388e-4273-875f-9ad1f9165fbc req-45db13d5-2cb4-4fc3-b28f-6debf0934112 service nova] Creating event network-vif-deleted:b76c9762-9bbc-412c-a457-c5a1559ffe6b for instance 4aa66639-fe9f-4d4a-be8d-72becd784196 on hv-cinder-68088 Nov 15 12:42:45.503948 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [req-bd61b732-388e-4273-875f-9ad1f9165fbc req-45db13d5-2cb4-4fc3-b28f-6debf0934112 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032092 Nov 15 12:42:45.504547 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 258/484] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:42:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:42:45.511285 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-7acf676d-40d8-4932-b28a-68721b688e7b tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:45.512651 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-7acf676d-40d8-4932-b28a-68721b688e7b tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] [instance: 4aa66639-fe9f-4d4a-be8d-72becd784196] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:45.520996 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7acf676d-40d8-4932-b28a-68721b688e7b tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:45.520996 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7acf676d-40d8-4932-b28a-68721b688e7b tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:45.520996 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7acf676d-40d8-4932-b28a-68721b688e7b tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:45.520996 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7acf676d-40d8-4932-b28a-68721b688e7b tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:45.560989 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-435ed63c-8a91-4da5-a17b-a2f20dfd239f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:45.561821 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-435ed63c-8a91-4da5-a17b-a2f20dfd239f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:45.568957 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-435ed63c-8a91-4da5-a17b-a2f20dfd239f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:45.569517 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-435ed63c-8a91-4da5-a17b-a2f20dfd239f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:45.570393 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-435ed63c-8a91-4da5-a17b-a2f20dfd239f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:45.571108 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-435ed63c-8a91-4da5-a17b-a2f20dfd239f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:45.584396 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-7acf676d-40d8-4932-b28a-68721b688e7b tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8d6f474c84a7b8888c60b5fcf1750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2957be7c6842c2b5ab55e4c5b80b61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:45.593534 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-7acf676d-40d8-4932-b28a-68721b688e7b tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] 10.222.0.43 "GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196" status: 200 len: 1428 microversion: 2.1 time: 0.085708 Nov 15 12:42:45.594281 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 227/485] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:45 2021] GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196 => generated 1428 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:45.604772 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.objects.instance [None req-435ed63c-8a91-4da5-a17b-a2f20dfd239f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lazy-loading 'flavor' on Instance uuid 11daa0bc-1e25-47d7-a6df-ffc808e1ff58 {{(pid=122567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 15 12:42:45.791120 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-79effc7f-55d9-4bdb-98dd-b431be31af0e tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:45.791632 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-79effc7f-55d9-4bdb-98dd-b431be31af0e tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:45.798478 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-79effc7f-55d9-4bdb-98dd-b431be31af0e tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:45.798937 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-79effc7f-55d9-4bdb-98dd-b431be31af0e tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:45.799698 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-79effc7f-55d9-4bdb-98dd-b431be31af0e tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:45.800125 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-79effc7f-55d9-4bdb-98dd-b431be31af0e tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:45.874298 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-435ed63c-8a91-4da5-a17b-a2f20dfd239f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 202 len: 0 microversion: 2.20 time: 0.319397 Nov 15 12:42:45.878006 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 259/486] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:42:45 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 15 12:42:45.883275 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-965909f9-7ee2-4c7d-817d-82945fcf3434 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:45.883967 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-965909f9-7ee2-4c7d-817d-82945fcf3434 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:45.891366 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-965909f9-7ee2-4c7d-817d-82945fcf3434 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:45.891798 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-965909f9-7ee2-4c7d-817d-82945fcf3434 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:45.892571 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-965909f9-7ee2-4c7d-817d-82945fcf3434 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:45.893017 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-965909f9-7ee2-4c7d-817d-82945fcf3434 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:45.944578 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-79effc7f-55d9-4bdb-98dd-b431be31af0e tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:45.952810 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-79effc7f-55d9-4bdb-98dd-b431be31af0e tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1260 microversion: 2.1 time: 0.165344 Nov 15 12:42:45.953374 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 228/487] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:45 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:42:46.029306 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-965909f9-7ee2-4c7d-817d-82945fcf3434 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:46.037095 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-965909f9-7ee2-4c7d-817d-82945fcf3434 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:46.038602 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-965909f9-7ee2-4c7d-817d-82945fcf3434 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:46.039788 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-965909f9-7ee2-4c7d-817d-82945fcf3434 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1725 microversion: 2.20 time: 0.160494 Nov 15 12:42:46.040350 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 260/488] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:42:45 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:42:46.132059 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-84d90546-c0dd-4fdd-b998-420727fbbf4b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:46.132574 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-84d90546-c0dd-4fdd-b998-420727fbbf4b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:46.139147 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-84d90546-c0dd-4fdd-b998-420727fbbf4b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:46.139589 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-84d90546-c0dd-4fdd-b998-420727fbbf4b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:46.140351 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-84d90546-c0dd-4fdd-b998-420727fbbf4b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:46.140770 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-84d90546-c0dd-4fdd-b998-420727fbbf4b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:46.272262 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-84d90546-c0dd-4fdd-b998-420727fbbf4b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:46.280351 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-84d90546-c0dd-4fdd-b998-420727fbbf4b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1567 microversion: 2.1 time: 0.152056 Nov 15 12:42:46.280921 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 229/489] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:46 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:46.611603 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-0c960618-463d-4c61-a6a5-f6069a82ed28 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:46.612197 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-0c960618-463d-4c61-a6a5-f6069a82ed28 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] [instance: 4aa66639-fe9f-4d4a-be8d-72becd784196] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:46.619142 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0c960618-463d-4c61-a6a5-f6069a82ed28 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:46.619593 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0c960618-463d-4c61-a6a5-f6069a82ed28 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:46.620385 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0c960618-463d-4c61-a6a5-f6069a82ed28 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:46.621463 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0c960618-463d-4c61-a6a5-f6069a82ed28 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:46.689010 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-0c960618-463d-4c61-a6a5-f6069a82ed28 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8d6f474c84a7b8888c60b5fcf1750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2957be7c6842c2b5ab55e4c5b80b61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:46.696434 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-0c960618-463d-4c61-a6a5-f6069a82ed28 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] 10.222.0.43 "GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196" status: 200 len: 1428 microversion: 2.1 time: 0.088754 Nov 15 12:42:46.697006 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 261/490] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:46 2021] GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196 => generated 1428 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:46.970179 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-64996ae0-7077-4d10-9770-2649a3a63b1e tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:46.970812 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-64996ae0-7077-4d10-9770-2649a3a63b1e tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:46.977036 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-64996ae0-7077-4d10-9770-2649a3a63b1e tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:46.977468 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-64996ae0-7077-4d10-9770-2649a3a63b1e tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:46.978219 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-64996ae0-7077-4d10-9770-2649a3a63b1e tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:46.978639 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-64996ae0-7077-4d10-9770-2649a3a63b1e tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:47.058634 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-ebec64c2-4ab1-475c-89e8-d7f1a00bef02 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:47.059372 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-ebec64c2-4ab1-475c-89e8-d7f1a00bef02 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:47.065205 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ebec64c2-4ab1-475c-89e8-d7f1a00bef02 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:47.065655 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ebec64c2-4ab1-475c-89e8-d7f1a00bef02 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:47.066436 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ebec64c2-4ab1-475c-89e8-d7f1a00bef02 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:47.066900 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ebec64c2-4ab1-475c-89e8-d7f1a00bef02 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:47.121502 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-64996ae0-7077-4d10-9770-2649a3a63b1e tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:47.128916 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-64996ae0-7077-4d10-9770-2649a3a63b1e tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1260 microversion: 2.1 time: 0.162333 Nov 15 12:42:47.129479 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 230/491] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:46 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:42:47.215198 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-ebec64c2-4ab1-475c-89e8-d7f1a00bef02 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:47.224540 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-ebec64c2-4ab1-475c-89e8-d7f1a00bef02 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:47.226079 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-ebec64c2-4ab1-475c-89e8-d7f1a00bef02 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:47.227332 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-ebec64c2-4ab1-475c-89e8-d7f1a00bef02 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1725 microversion: 2.20 time: 0.172456 Nov 15 12:42:47.227889 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 262/492] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:42:47 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 15 12:42:47.297053 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-ad124899-e8c0-4a41-a791-0b3455b437dd tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:47.297933 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-ad124899-e8c0-4a41-a791-0b3455b437dd tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:47.303868 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ad124899-e8c0-4a41-a791-0b3455b437dd tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:47.304306 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ad124899-e8c0-4a41-a791-0b3455b437dd tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:47.305097 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ad124899-e8c0-4a41-a791-0b3455b437dd tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:47.305520 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ad124899-e8c0-4a41-a791-0b3455b437dd tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:47.438620 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-ad124899-e8c0-4a41-a791-0b3455b437dd tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:47.446280 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-ad124899-e8c0-4a41-a791-0b3455b437dd tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1567 microversion: 2.1 time: 0.152898 Nov 15 12:42:47.446856 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 231/493] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:47 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:47.714007 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-05256dc5-90f7-4e14-9423-a9ee3af2199a tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:47.715559 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-05256dc5-90f7-4e14-9423-a9ee3af2199a tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] [instance: 4aa66639-fe9f-4d4a-be8d-72becd784196] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:47.721967 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-05256dc5-90f7-4e14-9423-a9ee3af2199a tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:47.722410 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-05256dc5-90f7-4e14-9423-a9ee3af2199a tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:47.723226 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-05256dc5-90f7-4e14-9423-a9ee3af2199a tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:47.723662 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-05256dc5-90f7-4e14-9423-a9ee3af2199a tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:47.783809 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-05256dc5-90f7-4e14-9423-a9ee3af2199a tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8d6f474c84a7b8888c60b5fcf1750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2957be7c6842c2b5ab55e4c5b80b61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:47.791153 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-05256dc5-90f7-4e14-9423-a9ee3af2199a tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] 10.222.0.43 "GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196" status: 200 len: 1300 microversion: 2.1 time: 0.080734 Nov 15 12:42:47.791734 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 263/494] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:47 2021] GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196 => generated 1300 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:48.145778 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-300178cd-e43d-46e5-b9fe-dccb8a579668 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:48.146377 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-300178cd-e43d-46e5-b9fe-dccb8a579668 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:48.153186 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-300178cd-e43d-46e5-b9fe-dccb8a579668 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:48.153618 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-300178cd-e43d-46e5-b9fe-dccb8a579668 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:48.154388 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-300178cd-e43d-46e5-b9fe-dccb8a579668 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:48.154837 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-300178cd-e43d-46e5-b9fe-dccb8a579668 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:48.245299 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-c19dc48a-908c-451d-8755-063454d2c56c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:48.246217 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-c19dc48a-908c-451d-8755-063454d2c56c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:48.253295 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c19dc48a-908c-451d-8755-063454d2c56c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:48.255389 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c19dc48a-908c-451d-8755-063454d2c56c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:48.255800 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c19dc48a-908c-451d-8755-063454d2c56c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:48.256505 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c19dc48a-908c-451d-8755-063454d2c56c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:48.327422 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-300178cd-e43d-46e5-b9fe-dccb8a579668 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:48.335497 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-300178cd-e43d-46e5-b9fe-dccb8a579668 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1260 microversion: 2.1 time: 0.193383 Nov 15 12:42:48.336390 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 232/495] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:48 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1260 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:48.415427 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-c19dc48a-908c-451d-8755-063454d2c56c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:48.424289 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-c19dc48a-908c-451d-8755-063454d2c56c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:48.425800 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-c19dc48a-908c-451d-8755-063454d2c56c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:48.427006 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-c19dc48a-908c-451d-8755-063454d2c56c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1725 microversion: 2.20 time: 0.185418 Nov 15 12:42:48.427563 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 264/496] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:42:48 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:42:48.462420 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-0b828759-8f79-4ab0-aeed-049b91fc9aba tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:48.463035 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-0b828759-8f79-4ab0-aeed-049b91fc9aba tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:48.469912 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0b828759-8f79-4ab0-aeed-049b91fc9aba tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:48.470346 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0b828759-8f79-4ab0-aeed-049b91fc9aba tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:48.471145 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0b828759-8f79-4ab0-aeed-049b91fc9aba tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:48.471564 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0b828759-8f79-4ab0-aeed-049b91fc9aba tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:48.613256 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-0b828759-8f79-4ab0-aeed-049b91fc9aba tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:48.622531 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-0b828759-8f79-4ab0-aeed-049b91fc9aba tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1567 microversion: 2.1 time: 0.163651 Nov 15 12:42:48.623156 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 233/497] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:48 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:48.809743 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-6b6bcbbe-6913-4507-8b07-8f5537f13d47 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:48.810384 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-6b6bcbbe-6913-4507-8b07-8f5537f13d47 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] [instance: 4aa66639-fe9f-4d4a-be8d-72becd784196] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:48.817277 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6b6bcbbe-6913-4507-8b07-8f5537f13d47 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:48.817726 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6b6bcbbe-6913-4507-8b07-8f5537f13d47 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:48.818502 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6b6bcbbe-6913-4507-8b07-8f5537f13d47 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:48.818965 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6b6bcbbe-6913-4507-8b07-8f5537f13d47 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:48.851749 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6b6bcbbe-6913-4507-8b07-8f5537f13d47 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:48.852450 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6b6bcbbe-6913-4507-8b07-8f5537f13d47 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:48.852899 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.objects.instance [None req-6b6bcbbe-6913-4507-8b07-8f5537f13d47 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lazy-loading 'fault' on Instance uuid 4aa66639-fe9f-4d4a-be8d-72becd784196 {{(pid=122567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 15 12:42:48.900669 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-6b6bcbbe-6913-4507-8b07-8f5537f13d47 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8d6f474c84a7b8888c60b5fcf1750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2957be7c6842c2b5ab55e4c5b80b61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:48.910487 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-6b6bcbbe-6913-4507-8b07-8f5537f13d47 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] 10.222.0.43 "GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196" status: 200 len: 1305 microversion: 2.1 time: 0.104592 Nov 15 12:42:48.911381 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 265/498] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:48 2021] GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196 => generated 1305 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:49.353169 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-a89f411c-1dd9-46da-8757-d50e67c3fd00 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:49.353847 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-a89f411c-1dd9-46da-8757-d50e67c3fd00 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:49.361105 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a89f411c-1dd9-46da-8757-d50e67c3fd00 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:49.361544 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a89f411c-1dd9-46da-8757-d50e67c3fd00 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:49.362346 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a89f411c-1dd9-46da-8757-d50e67c3fd00 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:49.362791 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a89f411c-1dd9-46da-8757-d50e67c3fd00 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:49.445802 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-df8f68bc-4298-448d-a188-b656bb8bc46d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:49.446382 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-df8f68bc-4298-448d-a188-b656bb8bc46d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:49.454262 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-df8f68bc-4298-448d-a188-b656bb8bc46d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:49.454262 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-df8f68bc-4298-448d-a188-b656bb8bc46d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:49.455222 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-df8f68bc-4298-448d-a188-b656bb8bc46d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:49.455828 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-df8f68bc-4298-448d-a188-b656bb8bc46d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:49.530067 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-a89f411c-1dd9-46da-8757-d50e67c3fd00 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:49.538592 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-a89f411c-1dd9-46da-8757-d50e67c3fd00 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1260 microversion: 2.1 time: 0.189108 Nov 15 12:42:49.548870 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 234/499] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:49 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1260 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:49.611491 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-df8f68bc-4298-448d-a188-b656bb8bc46d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:49.619872 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-df8f68bc-4298-448d-a188-b656bb8bc46d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:49.622112 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-df8f68bc-4298-448d-a188-b656bb8bc46d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:49.623343 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-df8f68bc-4298-448d-a188-b656bb8bc46d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1725 microversion: 2.20 time: 0.181528 Nov 15 12:42:49.623902 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 266/500] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:42:49 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:42:49.643531 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-e8760e21-c76c-490c-975e-d9ba85b19319 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:49.644134 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-e8760e21-c76c-490c-975e-d9ba85b19319 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:49.650177 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e8760e21-c76c-490c-975e-d9ba85b19319 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:49.650623 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e8760e21-c76c-490c-975e-d9ba85b19319 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:49.651430 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e8760e21-c76c-490c-975e-d9ba85b19319 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:49.651891 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e8760e21-c76c-490c-975e-d9ba85b19319 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:49.784430 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-e8760e21-c76c-490c-975e-d9ba85b19319 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:49.792176 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-e8760e21-c76c-490c-975e-d9ba85b19319 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1567 microversion: 2.1 time: 0.152344 Nov 15 12:42:49.792846 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 235/501] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:49 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:49.933326 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-0dd502c6-de0e-4aec-bdbc-9c5e5bd4f3b5 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:49.934049 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-0dd502c6-de0e-4aec-bdbc-9c5e5bd4f3b5 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] [instance: 4aa66639-fe9f-4d4a-be8d-72becd784196] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:49.940433 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0dd502c6-de0e-4aec-bdbc-9c5e5bd4f3b5 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:49.940882 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0dd502c6-de0e-4aec-bdbc-9c5e5bd4f3b5 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:49.941660 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0dd502c6-de0e-4aec-bdbc-9c5e5bd4f3b5 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:49.942093 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0dd502c6-de0e-4aec-bdbc-9c5e5bd4f3b5 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:49.957046 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.wsgi [None req-0dd502c6-de0e-4aec-bdbc-9c5e5bd4f3b5 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] HTTP exception thrown: Instance 4aa66639-fe9f-4d4a-be8d-72becd784196 could not be found. Nov 15 12:42:49.957637 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-0dd502c6-de0e-4aec-bdbc-9c5e5bd4f3b5 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] Returning 404 to user: Instance 4aa66639-fe9f-4d4a-be8d-72becd784196 could not be found. {{(pid=122567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:42:49.958467 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-0dd502c6-de0e-4aec-bdbc-9c5e5bd4f3b5 tempest-VolumesNegativeTest-1915572715 tempest-VolumesNegativeTest-1915572715-project] 10.222.0.43 "GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196" status: 404 len: 111 microversion: 2.1 time: 0.028867 Nov 15 12:42:49.959053 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 267/502] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:49 2021] GET /compute/v2.1/servers/4aa66639-fe9f-4d4a-be8d-72becd784196 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 15 12:42:50.555820 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-3d8c5b5f-3cde-4888-8d75-a69fe92f72e6 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:50.556421 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-3d8c5b5f-3cde-4888-8d75-a69fe92f72e6 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:50.564031 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3d8c5b5f-3cde-4888-8d75-a69fe92f72e6 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:50.564475 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3d8c5b5f-3cde-4888-8d75-a69fe92f72e6 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:50.565258 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3d8c5b5f-3cde-4888-8d75-a69fe92f72e6 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:50.565862 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3d8c5b5f-3cde-4888-8d75-a69fe92f72e6 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:50.641686 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-c5955046-d2aa-4183-bd94-d2fb864974b3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:50.642288 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-c5955046-d2aa-4183-bd94-d2fb864974b3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:50.648131 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c5955046-d2aa-4183-bd94-d2fb864974b3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:50.648735 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c5955046-d2aa-4183-bd94-d2fb864974b3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:50.649515 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c5955046-d2aa-4183-bd94-d2fb864974b3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:50.650180 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c5955046-d2aa-4183-bd94-d2fb864974b3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:50.717119 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-3d8c5b5f-3cde-4888-8d75-a69fe92f72e6 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:50.725359 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-3d8c5b5f-3cde-4888-8d75-a69fe92f72e6 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1260 microversion: 2.1 time: 0.173169 Nov 15 12:42:50.726124 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 236/503] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:50 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:50.804804 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-c5955046-d2aa-4183-bd94-d2fb864974b3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:50.811640 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-78468cc2-7e2d-4e74-8d6c-7f99414259ba tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:50.812873 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-78468cc2-7e2d-4e74-8d6c-7f99414259ba tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:50.814192 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-c5955046-d2aa-4183-bd94-d2fb864974b3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:50.815837 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-c5955046-d2aa-4183-bd94-d2fb864974b3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:50.817118 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-c5955046-d2aa-4183-bd94-d2fb864974b3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1725 microversion: 2.20 time: 0.179241 Nov 15 12:42:50.817670 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 268/504] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:42:50 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 15 12:42:50.821722 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-78468cc2-7e2d-4e74-8d6c-7f99414259ba tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:50.822171 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-78468cc2-7e2d-4e74-8d6c-7f99414259ba tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:50.822990 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-78468cc2-7e2d-4e74-8d6c-7f99414259ba tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:50.823418 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-78468cc2-7e2d-4e74-8d6c-7f99414259ba tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:50.974061 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-78468cc2-7e2d-4e74-8d6c-7f99414259ba tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:50.981990 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-78468cc2-7e2d-4e74-8d6c-7f99414259ba tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1567 microversion: 2.1 time: 0.176500 Nov 15 12:42:50.982573 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 237/505] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:50 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:42:51.741839 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-069569ec-df09-485c-8683-7bf90b1b57fd tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:51.742431 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-069569ec-df09-485c-8683-7bf90b1b57fd tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:51.749339 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-069569ec-df09-485c-8683-7bf90b1b57fd tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:51.749778 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-069569ec-df09-485c-8683-7bf90b1b57fd tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:51.750563 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-069569ec-df09-485c-8683-7bf90b1b57fd tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:51.751015 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-069569ec-df09-485c-8683-7bf90b1b57fd tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:51.837851 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-f2fa993c-b98a-4900-a860-d923c3b21d2c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:51.838452 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-f2fa993c-b98a-4900-a860-d923c3b21d2c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:51.853986 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f2fa993c-b98a-4900-a860-d923c3b21d2c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:51.853986 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f2fa993c-b98a-4900-a860-d923c3b21d2c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:51.853986 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f2fa993c-b98a-4900-a860-d923c3b21d2c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:51.853986 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f2fa993c-b98a-4900-a860-d923c3b21d2c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:51.912358 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-069569ec-df09-485c-8683-7bf90b1b57fd tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:51.923239 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-069569ec-df09-485c-8683-7bf90b1b57fd tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1260 microversion: 2.1 time: 0.184595 Nov 15 12:42:51.924406 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 269/506] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:51 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:52.000000 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-763e8b84-55e4-4ff1-b803-f64f429c7fbe tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:52.000775 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-763e8b84-55e4-4ff1-b803-f64f429c7fbe tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:52.007484 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-763e8b84-55e4-4ff1-b803-f64f429c7fbe tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:52.008070 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-763e8b84-55e4-4ff1-b803-f64f429c7fbe tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:52.009110 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-763e8b84-55e4-4ff1-b803-f64f429c7fbe tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:52.009749 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-763e8b84-55e4-4ff1-b803-f64f429c7fbe tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:52.045978 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-f2fa993c-b98a-4900-a860-d923c3b21d2c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:52.055774 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-f2fa993c-b98a-4900-a860-d923c3b21d2c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:52.057284 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-f2fa993c-b98a-4900-a860-d923c3b21d2c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:52.063150 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-f2fa993c-b98a-4900-a860-d923c3b21d2c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1725 microversion: 2.20 time: 0.225055 Nov 15 12:42:52.063947 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 238/507] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:42:51 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1725 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:42:52.151998 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-763e8b84-55e4-4ff1-b803-f64f429c7fbe tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:52.159915 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-763e8b84-55e4-4ff1-b803-f64f429c7fbe tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1567 microversion: 2.1 time: 0.164532 Nov 15 12:42:52.160475 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 270/508] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:51 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:42:52.941234 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-bb443ea6-7b00-4e96-a127-7b894af3b5a9 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:52.941816 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-bb443ea6-7b00-4e96-a127-7b894af3b5a9 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:52.948150 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bb443ea6-7b00-4e96-a127-7b894af3b5a9 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:52.948597 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bb443ea6-7b00-4e96-a127-7b894af3b5a9 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:52.950459 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bb443ea6-7b00-4e96-a127-7b894af3b5a9 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:52.950937 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bb443ea6-7b00-4e96-a127-7b894af3b5a9 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:53.084530 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-bb443ea6-7b00-4e96-a127-7b894af3b5a9 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:53.088451 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e6233ac6-de8f-4236-b3f5-7609cd81bf6f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:53.089062 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e6233ac6-de8f-4236-b3f5-7609cd81bf6f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:53.094458 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-bb443ea6-7b00-4e96-a127-7b894af3b5a9 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1260 microversion: 2.1 time: 0.156776 Nov 15 12:42:53.095287 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 239/509] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:52 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:53.103685 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e6233ac6-de8f-4236-b3f5-7609cd81bf6f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:53.104411 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e6233ac6-de8f-4236-b3f5-7609cd81bf6f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:53.105878 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e6233ac6-de8f-4236-b3f5-7609cd81bf6f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:53.106314 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e6233ac6-de8f-4236-b3f5-7609cd81bf6f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:53.177437 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-03226f47-3d42-4686-b4e0-67bf73ab9edf tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:53.178039 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-03226f47-3d42-4686-b4e0-67bf73ab9edf tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:53.184537 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-03226f47-3d42-4686-b4e0-67bf73ab9edf tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:53.184977 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-03226f47-3d42-4686-b4e0-67bf73ab9edf tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:53.185787 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-03226f47-3d42-4686-b4e0-67bf73ab9edf tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:53.186239 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-03226f47-3d42-4686-b4e0-67bf73ab9edf tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:53.290699 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e6233ac6-de8f-4236-b3f5-7609cd81bf6f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:53.299871 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e6233ac6-de8f-4236-b3f5-7609cd81bf6f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:53.301360 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e6233ac6-de8f-4236-b3f5-7609cd81bf6f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:53.302547 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e6233ac6-de8f-4236-b3f5-7609cd81bf6f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1725 microversion: 2.20 time: 0.224927 Nov 15 12:42:53.303146 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 271/510] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:42:53 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1725 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 15 12:42:53.361846 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-03226f47-3d42-4686-b4e0-67bf73ab9edf tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:53.369677 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-03226f47-3d42-4686-b4e0-67bf73ab9edf tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1547 microversion: 2.1 time: 0.196132 Nov 15 12:42:53.370249 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 240/511] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:53 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1547 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:42:53.387525 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-6f0f1968-4290-4a84-9e11-a307b0085c4e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:53.388113 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-6f0f1968-4290-4a84-9e11-a307b0085c4e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:53.394485 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6f0f1968-4290-4a84-9e11-a307b0085c4e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:53.395797 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6f0f1968-4290-4a84-9e11-a307b0085c4e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:53.396593 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6f0f1968-4290-4a84-9e11-a307b0085c4e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:53.397022 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6f0f1968-4290-4a84-9e11-a307b0085c4e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:53.520209 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.wsgi [None req-6f0f1968-4290-4a84-9e11-a307b0085c4e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] HTTP exception thrown: Cannot 'detach_volume' instance aea00c4f-da8f-4b9e-8c12-7ebe91776986 while it is in vm_state rescued Nov 15 12:42:53.520818 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-6f0f1968-4290-4a84-9e11-a307b0085c4e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Returning 409 to user: Cannot 'detach_volume' instance aea00c4f-da8f-4b9e-8c12-7ebe91776986 while it is in vm_state rescued {{(pid=122567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:42:53.521652 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-6f0f1968-4290-4a84-9e11-a307b0085c4e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "DELETE /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986/os-volume_attachments/0ffb6da6-a2ad-4d24-990b-77a1fe531307" status: 409 len: 152 microversion: 2.1 time: 0.138760 Nov 15 12:42:53.522201 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 272/512] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Nov 15 12:42:53 2021] DELETE /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986/os-volume_attachments/0ffb6da6-a2ad-4d24-990b-77a1fe531307 => generated 152 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 15 12:42:53.530850 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-b7878db7-29d7-492b-af42-ad3e990fc0b9 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:42:53.531402 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-b7878db7-29d7-492b-af42-ad3e990fc0b9 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:53.537422 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b7878db7-29d7-492b-af42-ad3e990fc0b9 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:53.537870 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b7878db7-29d7-492b-af42-ad3e990fc0b9 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:53.538800 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b7878db7-29d7-492b-af42-ad3e990fc0b9 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:53.539183 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b7878db7-29d7-492b-af42-ad3e990fc0b9 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:53.607404 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-b7878db7-29d7-492b-af42-ad3e990fc0b9 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "POST /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986/action" status: 202 len: 0 microversion: 2.1 time: 0.080317 Nov 15 12:42:53.608044 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 241/513] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:42:53 2021] POST /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 15 12:42:53.616204 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-60bc5f4e-24eb-447f-9029-23198573afa0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:53.616818 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-60bc5f4e-24eb-447f-9029-23198573afa0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:53.624063 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-60bc5f4e-24eb-447f-9029-23198573afa0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:53.624521 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-60bc5f4e-24eb-447f-9029-23198573afa0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:53.625379 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-60bc5f4e-24eb-447f-9029-23198573afa0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:53.625843 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-60bc5f4e-24eb-447f-9029-23198573afa0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:53.790764 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-60bc5f4e-24eb-447f-9029-23198573afa0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:53.800129 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-60bc5f4e-24eb-447f-9029-23198573afa0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1555 microversion: 2.1 time: 0.187641 Nov 15 12:42:53.801620 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 273/514] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:53 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1555 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:54.112444 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-51e3771b-8cbd-432e-91db-000c5bc6d3eb tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:54.113547 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-51e3771b-8cbd-432e-91db-000c5bc6d3eb tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:54.120145 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-51e3771b-8cbd-432e-91db-000c5bc6d3eb tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:54.120597 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-51e3771b-8cbd-432e-91db-000c5bc6d3eb tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:54.121783 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-51e3771b-8cbd-432e-91db-000c5bc6d3eb tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:54.122225 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-51e3771b-8cbd-432e-91db-000c5bc6d3eb tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:54.322363 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-5124b04d-14f5-4bfa-a12f-432e6db9d645 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:54.322992 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-5124b04d-14f5-4bfa-a12f-432e6db9d645 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:54.323123 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-51e3771b-8cbd-432e-91db-000c5bc6d3eb tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:54.332335 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-51e3771b-8cbd-432e-91db-000c5bc6d3eb tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1260 microversion: 2.1 time: 0.223759 Nov 15 12:42:54.333305 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 242/515] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:54 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1260 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:54.341505 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5124b04d-14f5-4bfa-a12f-432e6db9d645 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:54.341958 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5124b04d-14f5-4bfa-a12f-432e6db9d645 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:54.342803 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5124b04d-14f5-4bfa-a12f-432e6db9d645 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:54.343315 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5124b04d-14f5-4bfa-a12f-432e6db9d645 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:54.502328 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-5124b04d-14f5-4bfa-a12f-432e6db9d645 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:54.513204 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-5124b04d-14f5-4bfa-a12f-432e6db9d645 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:54.514764 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-5124b04d-14f5-4bfa-a12f-432e6db9d645 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:54.516052 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-5124b04d-14f5-4bfa-a12f-432e6db9d645 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1725 microversion: 2.20 time: 0.198214 Nov 15 12:42:54.516688 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 274/516] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:42:54 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1725 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:42:54.820642 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-027f8106-dcbf-4121-9169-65c803300501 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:54.821287 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-027f8106-dcbf-4121-9169-65c803300501 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:54.827807 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-027f8106-dcbf-4121-9169-65c803300501 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:54.828256 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-027f8106-dcbf-4121-9169-65c803300501 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:54.829039 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-027f8106-dcbf-4121-9169-65c803300501 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:54.829505 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-027f8106-dcbf-4121-9169-65c803300501 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:54.969914 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-027f8106-dcbf-4121-9169-65c803300501 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:54.977769 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-027f8106-dcbf-4121-9169-65c803300501 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1555 microversion: 2.1 time: 0.160839 Nov 15 12:42:54.978449 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 243/517] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:54 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:42:55.349192 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-1be7f066-6844-41e7-8279-fe39a508abdc tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:55.349785 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-1be7f066-6844-41e7-8279-fe39a508abdc tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:55.358229 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1be7f066-6844-41e7-8279-fe39a508abdc tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:55.358820 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1be7f066-6844-41e7-8279-fe39a508abdc tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:55.359775 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1be7f066-6844-41e7-8279-fe39a508abdc tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:55.360216 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1be7f066-6844-41e7-8279-fe39a508abdc tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:55.509857 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-1be7f066-6844-41e7-8279-fe39a508abdc tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:55.518843 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-1be7f066-6844-41e7-8279-fe39a508abdc tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1260 microversion: 2.1 time: 0.173141 Nov 15 12:42:55.519635 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 275/518] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:55 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:55.538815 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-ef003481-b191-4b51-bf89-9cc6f687321f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:55.541242 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-ef003481-b191-4b51-bf89-9cc6f687321f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:55.549737 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ef003481-b191-4b51-bf89-9cc6f687321f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:55.550224 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ef003481-b191-4b51-bf89-9cc6f687321f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:55.550998 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ef003481-b191-4b51-bf89-9cc6f687321f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:55.551466 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ef003481-b191-4b51-bf89-9cc6f687321f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:55.723296 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-ef003481-b191-4b51-bf89-9cc6f687321f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:55.731986 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-ef003481-b191-4b51-bf89-9cc6f687321f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:55.733497 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-ef003481-b191-4b51-bf89-9cc6f687321f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:55.734655 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-ef003481-b191-4b51-bf89-9cc6f687321f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1725 microversion: 2.20 time: 0.199539 Nov 15 12:42:55.735280 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 244/519] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:42:55 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1725 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:42:55.994844 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-c37d3a29-f044-40eb-aa0f-18601668b567 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:55.995574 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-c37d3a29-f044-40eb-aa0f-18601668b567 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:56.001778 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c37d3a29-f044-40eb-aa0f-18601668b567 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:56.002226 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c37d3a29-f044-40eb-aa0f-18601668b567 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:56.003035 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c37d3a29-f044-40eb-aa0f-18601668b567 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:56.003491 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c37d3a29-f044-40eb-aa0f-18601668b567 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:56.145608 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-c37d3a29-f044-40eb-aa0f-18601668b567 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:56.154016 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-c37d3a29-f044-40eb-aa0f-18601668b567 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1555 microversion: 2.1 time: 0.162854 Nov 15 12:42:56.154578 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 276/520] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:55 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:56.536992 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-11e77f20-84aa-4df0-b105-661f8a852197 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:56.537596 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-11e77f20-84aa-4df0-b105-661f8a852197 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:56.543612 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-11e77f20-84aa-4df0-b105-661f8a852197 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:56.544200 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-11e77f20-84aa-4df0-b105-661f8a852197 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:56.544815 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-11e77f20-84aa-4df0-b105-661f8a852197 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:56.545278 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-11e77f20-84aa-4df0-b105-661f8a852197 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:56.686939 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-11e77f20-84aa-4df0-b105-661f8a852197 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:56.694891 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-11e77f20-84aa-4df0-b105-661f8a852197 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1260 microversion: 2.1 time: 0.161401 Nov 15 12:42:56.696305 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 245/521] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:56 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:56.701935 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-cc61581d-fa01-4d1b-925e-af82ed9bbdee tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:56.703609 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-cc61581d-fa01-4d1b-925e-af82ed9bbdee tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: d7de1403-72dd-46fd-b7a0-97e4d6c201d9] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:56.709958 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cc61581d-fa01-4d1b-925e-af82ed9bbdee tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:56.710393 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cc61581d-fa01-4d1b-925e-af82ed9bbdee tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:56.711312 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cc61581d-fa01-4d1b-925e-af82ed9bbdee tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:56.711633 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cc61581d-fa01-4d1b-925e-af82ed9bbdee tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:56.755408 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-5b9e6b33-efc6-4e4e-831f-1de33e727327 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:56.756705 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-5b9e6b33-efc6-4e4e-831f-1de33e727327 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:56.763899 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5b9e6b33-efc6-4e4e-831f-1de33e727327 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:56.764601 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5b9e6b33-efc6-4e4e-831f-1de33e727327 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:56.765906 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5b9e6b33-efc6-4e4e-831f-1de33e727327 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:56.766507 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5b9e6b33-efc6-4e4e-831f-1de33e727327 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:56.801946 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.objects.instance [None req-cc61581d-fa01-4d1b-925e-af82ed9bbdee tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lazy-loading 'services' on Instance uuid d7de1403-72dd-46fd-b7a0-97e4d6c201d9 {{(pid=122567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 15 12:42:56.934561 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-cc61581d-fa01-4d1b-925e-af82ed9bbdee tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9/os-volume_attachments/b4e8a17c-f21b-4a4a-9666-05894f7e13de" status: 202 len: 0 microversion: 2.1 time: 0.240798 Nov 15 12:42:56.935209 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 277/522] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Nov 15 12:42:56 2021] DELETE /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9/os-volume_attachments/b4e8a17c-f21b-4a4a-9666-05894f7e13de => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:42:56.956314 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-5b9e6b33-efc6-4e4e-831f-1de33e727327 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:56.966032 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-5b9e6b33-efc6-4e4e-831f-1de33e727327 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:56.967582 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-5b9e6b33-efc6-4e4e-831f-1de33e727327 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:56.968740 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-5b9e6b33-efc6-4e4e-831f-1de33e727327 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1725 microversion: 2.20 time: 0.218626 Nov 15 12:42:56.969561 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 246/523] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:42:56 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:42:57.171744 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-2dfe711b-c891-432c-87ab-182f29052241 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:57.172447 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-2dfe711b-c891-432c-87ab-182f29052241 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:57.180458 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2dfe711b-c891-432c-87ab-182f29052241 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:57.180898 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2dfe711b-c891-432c-87ab-182f29052241 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:57.181662 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2dfe711b-c891-432c-87ab-182f29052241 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:57.182086 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2dfe711b-c891-432c-87ab-182f29052241 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:57.318361 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-2dfe711b-c891-432c-87ab-182f29052241 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:57.326287 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-2dfe711b-c891-432c-87ab-182f29052241 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1561 microversion: 2.1 time: 0.159090 Nov 15 12:42:57.326873 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 278/524] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:57 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:57.397123 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-e17ba7e9-caa9-4bd4-b133-1b3b96ed493f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:57.397603 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-e17ba7e9-caa9-4bd4-b133-1b3b96ed493f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:57.403464 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e17ba7e9-caa9-4bd4-b133-1b3b96ed493f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:57.403899 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e17ba7e9-caa9-4bd4-b133-1b3b96ed493f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:57.404659 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e17ba7e9-caa9-4bd4-b133-1b3b96ed493f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:57.405081 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e17ba7e9-caa9-4bd4-b133-1b3b96ed493f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:57.532263 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.objects.instance [None req-e17ba7e9-caa9-4bd4-b133-1b3b96ed493f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lazy-loading 'services' on Instance uuid aea00c4f-da8f-4b9e-8c12-7ebe91776986 {{(pid=122568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 15 12:42:57.639416 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-e17ba7e9-caa9-4bd4-b133-1b3b96ed493f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "DELETE /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986/os-volume_attachments/0ffb6da6-a2ad-4d24-990b-77a1fe531307" status: 202 len: 0 microversion: 2.1 time: 0.245912 Nov 15 12:42:57.640209 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 247/525] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Nov 15 12:42:57 2021] DELETE /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986/os-volume_attachments/0ffb6da6-a2ad-4d24-990b-77a1fe531307 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 15 12:42:57.649245 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-966a7df6-05cf-4826-9d08-d124009aea4c tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:57.650652 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-966a7df6-05cf-4826-9d08-d124009aea4c tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:57.657118 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-966a7df6-05cf-4826-9d08-d124009aea4c tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:57.657582 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-966a7df6-05cf-4826-9d08-d124009aea4c tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:57.658524 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-966a7df6-05cf-4826-9d08-d124009aea4c tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:57.658985 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-966a7df6-05cf-4826-9d08-d124009aea4c tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:57.691054 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-966a7df6-05cf-4826-9d08-d124009aea4c tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046538 Nov 15 12:42:57.691614 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 279/526] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Nov 15 12:42:57 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:42:57.712659 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-f0ac6f1d-53cc-4bfa-bc6b-c11f20c0b586 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:57.713347 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-f0ac6f1d-53cc-4bfa-bc6b-c11f20c0b586 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:57.719648 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f0ac6f1d-53cc-4bfa-bc6b-c11f20c0b586 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:57.720094 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f0ac6f1d-53cc-4bfa-bc6b-c11f20c0b586 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:57.720863 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f0ac6f1d-53cc-4bfa-bc6b-c11f20c0b586 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:57.721294 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f0ac6f1d-53cc-4bfa-bc6b-c11f20c0b586 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:57.859929 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-f0ac6f1d-53cc-4bfa-bc6b-c11f20c0b586 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:57.867254 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-f0ac6f1d-53cc-4bfa-bc6b-c11f20c0b586 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1260 microversion: 2.1 time: 0.158712 Nov 15 12:42:57.867812 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 248/527] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:57 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:42:57.987307 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-257faec6-55d9-47f7-9b36-c33f9e103e3d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:57.987937 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-257faec6-55d9-47f7-9b36-c33f9e103e3d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:57.994179 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-257faec6-55d9-47f7-9b36-c33f9e103e3d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:57.994627 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-257faec6-55d9-47f7-9b36-c33f9e103e3d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:57.995514 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-257faec6-55d9-47f7-9b36-c33f9e103e3d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:57.996707 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-257faec6-55d9-47f7-9b36-c33f9e103e3d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:58.133433 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-257faec6-55d9-47f7-9b36-c33f9e103e3d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:58.141181 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-257faec6-55d9-47f7-9b36-c33f9e103e3d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:58.142823 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-257faec6-55d9-47f7-9b36-c33f9e103e3d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:58.143970 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-257faec6-55d9-47f7-9b36-c33f9e103e3d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1725 microversion: 2.20 time: 0.160422 Nov 15 12:42:58.144523 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 280/528] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:42:57 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:42:58.706506 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-268aa84d-5f4f-4d12-8dce-af1356e7da51 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:58.707505 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-268aa84d-5f4f-4d12-8dce-af1356e7da51 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:58.713447 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-268aa84d-5f4f-4d12-8dce-af1356e7da51 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:58.713886 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-268aa84d-5f4f-4d12-8dce-af1356e7da51 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:58.715251 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-268aa84d-5f4f-4d12-8dce-af1356e7da51 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:58.715679 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-268aa84d-5f4f-4d12-8dce-af1356e7da51 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:58.744886 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-268aa84d-5f4f-4d12-8dce-af1356e7da51 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045417 Nov 15 12:42:58.746002 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 249/529] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Nov 15 12:42:58 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:42:58.885695 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-041f7db2-88d4-4e23-b938-b5535bf53010 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:58.887237 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-041f7db2-88d4-4e23-b938-b5535bf53010 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:58.895542 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-041f7db2-88d4-4e23-b938-b5535bf53010 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:58.895994 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-041f7db2-88d4-4e23-b938-b5535bf53010 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:58.896781 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-041f7db2-88d4-4e23-b938-b5535bf53010 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:58.897223 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-041f7db2-88d4-4e23-b938-b5535bf53010 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:59.049730 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-041f7db2-88d4-4e23-b938-b5535bf53010 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:59.060015 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-041f7db2-88d4-4e23-b938-b5535bf53010 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1260 microversion: 2.1 time: 0.177848 Nov 15 12:42:59.060609 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 281/530] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:42:58 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:42:59.163128 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-20eac1b2-f00b-4812-8bc0-c8ed317ff08e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:59.163732 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-20eac1b2-f00b-4812-8bc0-c8ed317ff08e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:59.170268 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-20eac1b2-f00b-4812-8bc0-c8ed317ff08e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:59.170711 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-20eac1b2-f00b-4812-8bc0-c8ed317ff08e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:59.171518 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-20eac1b2-f00b-4812-8bc0-c8ed317ff08e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:59.171948 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-20eac1b2-f00b-4812-8bc0-c8ed317ff08e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:59.309735 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-20eac1b2-f00b-4812-8bc0-c8ed317ff08e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:59.317899 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-20eac1b2-f00b-4812-8bc0-c8ed317ff08e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:59.319445 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-20eac1b2-f00b-4812-8bc0-c8ed317ff08e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:42:59.320614 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-20eac1b2-f00b-4812-8bc0-c8ed317ff08e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1725 microversion: 2.20 time: 0.161180 Nov 15 12:42:59.321174 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 250/531] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:42:59 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:42:59.757078 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-2b45d944-4704-44b1-b668-398c3c320943 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:42:59.758031 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-2b45d944-4704-44b1-b668-398c3c320943 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:42:59.764464 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2b45d944-4704-44b1-b668-398c3c320943 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:59.764899 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2b45d944-4704-44b1-b668-398c3c320943 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:59.765665 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2b45d944-4704-44b1-b668-398c3c320943 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:42:59.766083 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2b45d944-4704-44b1-b668-398c3c320943 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:42:59.794062 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-2b45d944-4704-44b1-b668-398c3c320943 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040729 Nov 15 12:42:59.794596 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 282/532] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Nov 15 12:42:59 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:43:00.077598 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-46f268ff-8537-4dee-973a-8985fd1abb11 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:00.078214 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-46f268ff-8537-4dee-973a-8985fd1abb11 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:00.084589 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-46f268ff-8537-4dee-973a-8985fd1abb11 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:00.085039 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-46f268ff-8537-4dee-973a-8985fd1abb11 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:00.085827 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-46f268ff-8537-4dee-973a-8985fd1abb11 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:00.086262 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-46f268ff-8537-4dee-973a-8985fd1abb11 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:00.117717 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [req-ecaa53eb-eb7e-43e5-915f-da3bf34fbb1f req-42d8d8c4-6406-4479-a487-f0a436d1b14f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a56962f0-d8f9-4778-a21e-1f2bc81789fe", "name": "network-vif-plugged", "status": "completed", "tag": "5e3438d8-9d94-405a-af06-a2bd0727491d"}]} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:43:00.129025 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:43:00.129025 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: warnings.warn(msg) Nov 15 12:43:00.138947 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-ecaa53eb-eb7e-43e5-915f-da3bf34fbb1f req-42d8d8c4-6406-4479-a487-f0a436d1b14f service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:00.139390 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-ecaa53eb-eb7e-43e5-915f-da3bf34fbb1f req-42d8d8c4-6406-4479-a487-f0a436d1b14f service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:00.158529 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.compute.server_external_events [req-ecaa53eb-eb7e-43e5-915f-da3bf34fbb1f req-42d8d8c4-6406-4479-a487-f0a436d1b14f service nova] Creating event network-vif-plugged:5e3438d8-9d94-405a-af06-a2bd0727491d for instance a56962f0-d8f9-4778-a21e-1f2bc81789fe on hv-cinder-68088 Nov 15 12:43:00.170384 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [req-ecaa53eb-eb7e-43e5-915f-da3bf34fbb1f req-42d8d8c4-6406-4479-a487-f0a436d1b14f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057186 Nov 15 12:43:00.171583 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 283/533] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:43:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:43:00.234833 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-46f268ff-8537-4dee-973a-8985fd1abb11 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:00.242365 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-46f268ff-8537-4dee-973a-8985fd1abb11 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1260 microversion: 2.1 time: 0.169144 Nov 15 12:43:00.242975 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 251/534] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:00 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:00.341051 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-c4b8db77-95c0-49a6-a2c1-70f36e714ca4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:00.341681 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-c4b8db77-95c0-49a6-a2c1-70f36e714ca4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:00.347775 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c4b8db77-95c0-49a6-a2c1-70f36e714ca4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:00.348222 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c4b8db77-95c0-49a6-a2c1-70f36e714ca4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:00.348987 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c4b8db77-95c0-49a6-a2c1-70f36e714ca4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:00.349440 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c4b8db77-95c0-49a6-a2c1-70f36e714ca4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:00.511032 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-c4b8db77-95c0-49a6-a2c1-70f36e714ca4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:00.520168 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-c4b8db77-95c0-49a6-a2c1-70f36e714ca4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:00.521668 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-c4b8db77-95c0-49a6-a2c1-70f36e714ca4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:00.522870 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-c4b8db77-95c0-49a6-a2c1-70f36e714ca4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1725 microversion: 2.20 time: 0.186958 Nov 15 12:43:00.523432 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 284/535] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:00 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:00.805594 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-8a94affd-be49-4019-a429-b85546a43d8b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:00.806570 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-8a94affd-be49-4019-a429-b85546a43d8b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:00.813884 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8a94affd-be49-4019-a429-b85546a43d8b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:00.814334 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8a94affd-be49-4019-a429-b85546a43d8b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:00.815150 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8a94affd-be49-4019-a429-b85546a43d8b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:00.815591 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8a94affd-be49-4019-a429-b85546a43d8b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:00.845912 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-8a94affd-be49-4019-a429-b85546a43d8b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044039 Nov 15 12:43:00.846473 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 252/536] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Nov 15 12:43:00 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:43:01.233236 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-4ec8af43-6d78-420d-9ff8-2f708f1e0f38 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:01.233774 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-4ec8af43-6d78-420d-9ff8-2f708f1e0f38 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: d7de1403-72dd-46fd-b7a0-97e4d6c201d9] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:01.240210 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4ec8af43-6d78-420d-9ff8-2f708f1e0f38 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:01.240655 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4ec8af43-6d78-420d-9ff8-2f708f1e0f38 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:01.241431 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4ec8af43-6d78-420d-9ff8-2f708f1e0f38 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:01.241866 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4ec8af43-6d78-420d-9ff8-2f708f1e0f38 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:01.260549 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-9d4fb9d5-d8ca-454c-a5a9-a193246363df tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:01.261661 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-9d4fb9d5-d8ca-454c-a5a9-a193246363df tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:01.267977 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9d4fb9d5-d8ca-454c-a5a9-a193246363df tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:01.268423 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9d4fb9d5-d8ca-454c-a5a9-a193246363df tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:01.268596 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-4ec8af43-6d78-420d-9ff8-2f708f1e0f38 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: d7de1403-72dd-46fd-b7a0-97e4d6c201d9] Going to try to terminate instance {{(pid=122567) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 15 12:43:01.269198 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9d4fb9d5-d8ca-454c-a5a9-a193246363df tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:01.269630 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9d4fb9d5-d8ca-454c-a5a9-a193246363df tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:01.360063 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-4ec8af43-6d78-420d-9ff8-2f708f1e0f38 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9" status: 204 len: 0 microversion: 2.1 time: 0.130473 Nov 15 12:43:01.360994 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 285/537] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Nov 15 12:43:01 2021] DELETE /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 15 12:43:01.369430 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e32aad07-8a33-4fbb-9766-f4a4a7a97720 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:01.370179 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e32aad07-8a33-4fbb-9766-f4a4a7a97720 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: d7de1403-72dd-46fd-b7a0-97e4d6c201d9] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:01.377258 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e32aad07-8a33-4fbb-9766-f4a4a7a97720 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:01.377706 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e32aad07-8a33-4fbb-9766-f4a4a7a97720 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:01.378545 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e32aad07-8a33-4fbb-9766-f4a4a7a97720 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:01.379010 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e32aad07-8a33-4fbb-9766-f4a4a7a97720 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:01.433469 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-9d4fb9d5-d8ca-454c-a5a9-a193246363df tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:01.441507 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-9d4fb9d5-d8ca-454c-a5a9-a193246363df tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1260 microversion: 2.1 time: 0.184617 Nov 15 12:43:01.442275 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 253/538] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:01 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:43:01.527637 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e32aad07-8a33-4fbb-9766-f4a4a7a97720 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44c99bd2e434807b12facc77f18a5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aae5c632c8b4d4f94206b1d6745c0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:01.535369 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e32aad07-8a33-4fbb-9766-f4a4a7a97720 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "GET /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9" status: 200 len: 1515 microversion: 2.1 time: 0.169759 Nov 15 12:43:01.536033 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 286/539] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:01 2021] GET /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9 => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:43:01.545241 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-c3bcf280-09e6-488a-8a78-729a265c0b5b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:01.545841 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-c3bcf280-09e6-488a-8a78-729a265c0b5b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:01.552301 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c3bcf280-09e6-488a-8a78-729a265c0b5b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:01.552735 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c3bcf280-09e6-488a-8a78-729a265c0b5b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:01.553500 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c3bcf280-09e6-488a-8a78-729a265c0b5b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:01.553916 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c3bcf280-09e6-488a-8a78-729a265c0b5b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:01.687661 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-c3bcf280-09e6-488a-8a78-729a265c0b5b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:01.695354 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-c3bcf280-09e6-488a-8a78-729a265c0b5b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:01.696844 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-c3bcf280-09e6-488a-8a78-729a265c0b5b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:01.697975 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-c3bcf280-09e6-488a-8a78-729a265c0b5b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1725 microversion: 2.20 time: 0.159868 Nov 15 12:43:01.698598 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 254/540] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:01 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:01.858227 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-98a542db-cc03-474a-8516-508c1ebf8670 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:01.859143 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-98a542db-cc03-474a-8516-508c1ebf8670 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:01.865123 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-98a542db-cc03-474a-8516-508c1ebf8670 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:01.865578 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-98a542db-cc03-474a-8516-508c1ebf8670 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:01.866347 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-98a542db-cc03-474a-8516-508c1ebf8670 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:01.866800 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-98a542db-cc03-474a-8516-508c1ebf8670 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:01.895245 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-98a542db-cc03-474a-8516-508c1ebf8670 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041587 Nov 15 12:43:01.895802 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 287/541] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Nov 15 12:43:01 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:43:02.458577 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-1869f13d-ae7e-4951-b90f-b6eb3900e1a0 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:02.459220 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-1869f13d-ae7e-4951-b90f-b6eb3900e1a0 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:02.465584 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1869f13d-ae7e-4951-b90f-b6eb3900e1a0 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:02.466016 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1869f13d-ae7e-4951-b90f-b6eb3900e1a0 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:02.466794 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1869f13d-ae7e-4951-b90f-b6eb3900e1a0 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:02.467222 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1869f13d-ae7e-4951-b90f-b6eb3900e1a0 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:02.553357 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-638555b3-8eb0-4a5b-ad2b-780842c5ce86 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:02.554653 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-638555b3-8eb0-4a5b-ad2b-780842c5ce86 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: d7de1403-72dd-46fd-b7a0-97e4d6c201d9] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:02.562952 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-638555b3-8eb0-4a5b-ad2b-780842c5ce86 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:02.563763 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-638555b3-8eb0-4a5b-ad2b-780842c5ce86 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:02.565085 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-638555b3-8eb0-4a5b-ad2b-780842c5ce86 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:02.565710 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-638555b3-8eb0-4a5b-ad2b-780842c5ce86 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:02.603020 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-1869f13d-ae7e-4951-b90f-b6eb3900e1a0 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:02.612893 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-1869f13d-ae7e-4951-b90f-b6eb3900e1a0 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1445 microversion: 2.1 time: 0.157777 Nov 15 12:43:02.614541 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 255/542] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:02 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1445 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:02.631545 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-0e90c4a7-6e7a-47b7-8ee6-31a498c1d0c1 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:02.632157 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-0e90c4a7-6e7a-47b7-8ee6-31a498c1d0c1 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:02.638377 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0e90c4a7-6e7a-47b7-8ee6-31a498c1d0c1 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:02.638857 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0e90c4a7-6e7a-47b7-8ee6-31a498c1d0c1 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:02.639641 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0e90c4a7-6e7a-47b7-8ee6-31a498c1d0c1 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:02.640073 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0e90c4a7-6e7a-47b7-8ee6-31a498c1d0c1 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:02.738558 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-638555b3-8eb0-4a5b-ad2b-780842c5ce86 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44c99bd2e434807b12facc77f18a5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aae5c632c8b4d4f94206b1d6745c0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:02.746078 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-638555b3-8eb0-4a5b-ad2b-780842c5ce86 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "GET /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9" status: 200 len: 1515 microversion: 2.1 time: 0.196188 Nov 15 12:43:02.746661 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 288/543] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:02 2021] GET /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9 => generated 1515 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:43:02.750935 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-5e45457d-b65a-48f9-a9e9-88342528c745 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:02.751540 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-5e45457d-b65a-48f9-a9e9-88342528c745 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:02.757329 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5e45457d-b65a-48f9-a9e9-88342528c745 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:02.757782 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5e45457d-b65a-48f9-a9e9-88342528c745 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:02.758563 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5e45457d-b65a-48f9-a9e9-88342528c745 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:02.759026 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5e45457d-b65a-48f9-a9e9-88342528c745 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:02.814726 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-0e90c4a7-6e7a-47b7-8ee6-31a498c1d0c1 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:02.822281 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-0e90c4a7-6e7a-47b7-8ee6-31a498c1d0c1 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1445 microversion: 2.1 time: 0.194288 Nov 15 12:43:02.822882 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 256/544] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:02 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1445 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:43:02.905531 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-5e45457d-b65a-48f9-a9e9-88342528c745 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:02.906460 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-cfa36f8d-547e-4988-afdf-0ce7e3df9c6d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:02.907487 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-cfa36f8d-547e-4988-afdf-0ce7e3df9c6d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:02.913922 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-cfa36f8d-547e-4988-afdf-0ce7e3df9c6d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:02.914436 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-cfa36f8d-547e-4988-afdf-0ce7e3df9c6d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:02.915178 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-cfa36f8d-547e-4988-afdf-0ce7e3df9c6d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:02.915490 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-5e45457d-b65a-48f9-a9e9-88342528c745 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:02.915629 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-cfa36f8d-547e-4988-afdf-0ce7e3df9c6d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:02.917002 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-5e45457d-b65a-48f9-a9e9-88342528c745 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:02.919554 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-5e45457d-b65a-48f9-a9e9-88342528c745 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1725 microversion: 2.20 time: 0.171937 Nov 15 12:43:02.920120 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 289/545] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:02 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:02.957614 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-cfa36f8d-547e-4988-afdf-0ce7e3df9c6d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054824 Nov 15 12:43:02.958185 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 257/546] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Nov 15 12:43:02 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 15 12:43:03.764106 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-847e8cd6-8908-4367-8db6-3d5d76b34a8d tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:03.764919 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-847e8cd6-8908-4367-8db6-3d5d76b34a8d tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: d7de1403-72dd-46fd-b7a0-97e4d6c201d9] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:03.771587 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-847e8cd6-8908-4367-8db6-3d5d76b34a8d tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:03.772045 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-847e8cd6-8908-4367-8db6-3d5d76b34a8d tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:03.772936 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-847e8cd6-8908-4367-8db6-3d5d76b34a8d tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:03.773278 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-847e8cd6-8908-4367-8db6-3d5d76b34a8d tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:03.918725 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-847e8cd6-8908-4367-8db6-3d5d76b34a8d tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44c99bd2e434807b12facc77f18a5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aae5c632c8b4d4f94206b1d6745c0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:03.926501 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-847e8cd6-8908-4367-8db6-3d5d76b34a8d tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "GET /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9" status: 200 len: 1515 microversion: 2.1 time: 0.167389 Nov 15 12:43:03.927350 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 290/547] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:03 2021] GET /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9 => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:03.938556 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-bf374a62-930d-4e01-9c88-2611bfa9559d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:03.939200 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-bf374a62-930d-4e01-9c88-2611bfa9559d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:03.945382 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bf374a62-930d-4e01-9c88-2611bfa9559d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:03.945816 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bf374a62-930d-4e01-9c88-2611bfa9559d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:03.946583 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bf374a62-930d-4e01-9c88-2611bfa9559d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:03.947025 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bf374a62-930d-4e01-9c88-2611bfa9559d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:04.286677 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-bf374a62-930d-4e01-9c88-2611bfa9559d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:04.294980 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-bf374a62-930d-4e01-9c88-2611bfa9559d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:04.296470 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-bf374a62-930d-4e01-9c88-2611bfa9559d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:04.297889 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-bf374a62-930d-4e01-9c88-2611bfa9559d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1725 microversion: 2.20 time: 0.363455 Nov 15 12:43:04.298745 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 258/548] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:03 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1725 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:04.759529 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [req-668cb385-fc9a-48c8-86cd-ed3ab9d4e6b2 req-f2bccc49-e931-4cb5-9a40-eb7506f25992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7de1403-72dd-46fd-b7a0-97e4d6c201d9", "name": "network-vif-deleted", "tag": "7ce2ec7c-8faf-4005-8f1a-e50c4a7a1c29"}]} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:43:04.763040 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:43:04.763040 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: warnings.warn(msg) Nov 15 12:43:04.771092 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-668cb385-fc9a-48c8-86cd-ed3ab9d4e6b2 req-f2bccc49-e931-4cb5-9a40-eb7506f25992 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:04.771735 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-668cb385-fc9a-48c8-86cd-ed3ab9d4e6b2 req-f2bccc49-e931-4cb5-9a40-eb7506f25992 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:04.784799 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.compute.server_external_events [req-668cb385-fc9a-48c8-86cd-ed3ab9d4e6b2 req-f2bccc49-e931-4cb5-9a40-eb7506f25992 service nova] Creating event network-vif-deleted:7ce2ec7c-8faf-4005-8f1a-e50c4a7a1c29 for instance d7de1403-72dd-46fd-b7a0-97e4d6c201d9 on hv-cinder-68088 Nov 15 12:43:04.791604 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [req-668cb385-fc9a-48c8-86cd-ed3ab9d4e6b2 req-f2bccc49-e931-4cb5-9a40-eb7506f25992 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036917 Nov 15 12:43:04.792347 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 291/549] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:43:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:43:04.858850 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-7266d595-9961-41d7-bb8b-75d4f6c4b472 req-c783759b-edb4-43d6-98a5-b1e493a3120a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a56962f0-d8f9-4778-a21e-1f2bc81789fe", "tag": "5e3438d8-9d94-405a-af06-a2bd0727491d"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:43:04.861298 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:43:04.861298 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:43:04.869601 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-7266d595-9961-41d7-bb8b-75d4f6c4b472 req-c783759b-edb4-43d6-98a5-b1e493a3120a service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:04.870036 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-7266d595-9961-41d7-bb8b-75d4f6c4b472 req-c783759b-edb4-43d6-98a5-b1e493a3120a service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:04.883023 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-7266d595-9961-41d7-bb8b-75d4f6c4b472 req-c783759b-edb4-43d6-98a5-b1e493a3120a service nova] Creating event network-changed:5e3438d8-9d94-405a-af06-a2bd0727491d for instance a56962f0-d8f9-4778-a21e-1f2bc81789fe on hv-cinder-68088 Nov 15 12:43:04.888660 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-7266d595-9961-41d7-bb8b-75d4f6c4b472 req-c783759b-edb4-43d6-98a5-b1e493a3120a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036549 Nov 15 12:43:04.889276 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 259/550] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:43:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:43:04.945978 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-3d24b7ba-f7d9-43b1-ae63-25f471d10b6e tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:04.946820 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-3d24b7ba-f7d9-43b1-ae63-25f471d10b6e tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: d7de1403-72dd-46fd-b7a0-97e4d6c201d9] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:04.953243 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3d24b7ba-f7d9-43b1-ae63-25f471d10b6e tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:04.954083 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3d24b7ba-f7d9-43b1-ae63-25f471d10b6e tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:04.955178 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3d24b7ba-f7d9-43b1-ae63-25f471d10b6e tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:04.955685 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3d24b7ba-f7d9-43b1-ae63-25f471d10b6e tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:04.996297 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3d24b7ba-f7d9-43b1-ae63-25f471d10b6e tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:04.997091 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3d24b7ba-f7d9-43b1-ae63-25f471d10b6e tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:04.997795 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.objects.instance [None req-3d24b7ba-f7d9-43b1-ae63-25f471d10b6e tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lazy-loading 'fault' on Instance uuid d7de1403-72dd-46fd-b7a0-97e4d6c201d9 {{(pid=122567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 15 12:43:05.046595 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-3d24b7ba-f7d9-43b1-ae63-25f471d10b6e tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44c99bd2e434807b12facc77f18a5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aae5c632c8b4d4f94206b1d6745c0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:05.055297 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-3d24b7ba-f7d9-43b1-ae63-25f471d10b6e tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "GET /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9" status: 200 len: 1309 microversion: 2.1 time: 0.113220 Nov 15 12:43:05.055962 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 292/551] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:04 2021] GET /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9 => generated 1309 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:05.303484 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-772de32a-3bf0-4839-be1c-d921f111379e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:05.304399 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-772de32a-3bf0-4839-be1c-d921f111379e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:05.312468 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-772de32a-3bf0-4839-be1c-d921f111379e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:05.313057 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-772de32a-3bf0-4839-be1c-d921f111379e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:05.313929 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-772de32a-3bf0-4839-be1c-d921f111379e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:05.314449 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-772de32a-3bf0-4839-be1c-d921f111379e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:05.317254 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-3b54ba62-759c-4407-b61e-875c83662806 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:05.317864 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-3b54ba62-759c-4407-b61e-875c83662806 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:05.327266 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3b54ba62-759c-4407-b61e-875c83662806 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:05.327991 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3b54ba62-759c-4407-b61e-875c83662806 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:05.329088 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3b54ba62-759c-4407-b61e-875c83662806 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:05.329769 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3b54ba62-759c-4407-b61e-875c83662806 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:05.345831 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-772de32a-3bf0-4839-be1c-d921f111379e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Going to try to terminate instance {{(pid=122568) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 15 12:43:05.465638 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-772de32a-3bf0-4839-be1c-d921f111379e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 204 len: 0 microversion: 2.1 time: 0.165634 Nov 15 12:43:05.466267 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 260/552] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Nov 15 12:43:05 2021] DELETE /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 15 12:43:05.476662 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-2ad360f3-2530-45fe-bafa-bcc7abe81d70 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:05.477650 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-2ad360f3-2530-45fe-bafa-bcc7abe81d70 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:05.487200 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2ad360f3-2530-45fe-bafa-bcc7abe81d70 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:05.487920 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2ad360f3-2530-45fe-bafa-bcc7abe81d70 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:05.488904 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2ad360f3-2530-45fe-bafa-bcc7abe81d70 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:05.489479 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2ad360f3-2530-45fe-bafa-bcc7abe81d70 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:05.681036 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-3b54ba62-759c-4407-b61e-875c83662806 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:05.691285 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-3b54ba62-759c-4407-b61e-875c83662806 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:05.693476 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-3b54ba62-759c-4407-b61e-875c83662806 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:05.695241 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-3b54ba62-759c-4407-b61e-875c83662806 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1725 microversion: 2.20 time: 0.382446 Nov 15 12:43:05.695959 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 293/553] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:05 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1725 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 15 12:43:05.742073 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-2ad360f3-2530-45fe-bafa-bcc7abe81d70 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:05.750412 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-2ad360f3-2530-45fe-bafa-bcc7abe81d70 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1508 microversion: 2.1 time: 0.278032 Nov 15 12:43:05.751134 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 261/554] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:05 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1508 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:06.072525 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-0196372e-4341-4a5d-8f70-e24bea2c31c7 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:06.073553 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-0196372e-4341-4a5d-8f70-e24bea2c31c7 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: d7de1403-72dd-46fd-b7a0-97e4d6c201d9] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:06.081022 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0196372e-4341-4a5d-8f70-e24bea2c31c7 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:06.084282 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0196372e-4341-4a5d-8f70-e24bea2c31c7 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:06.084282 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0196372e-4341-4a5d-8f70-e24bea2c31c7 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:06.084282 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0196372e-4341-4a5d-8f70-e24bea2c31c7 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:06.098384 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.wsgi [None req-0196372e-4341-4a5d-8f70-e24bea2c31c7 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] HTTP exception thrown: Instance d7de1403-72dd-46fd-b7a0-97e4d6c201d9 could not be found. Nov 15 12:43:06.099031 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-0196372e-4341-4a5d-8f70-e24bea2c31c7 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Returning 404 to user: Instance d7de1403-72dd-46fd-b7a0-97e4d6c201d9 could not be found. {{(pid=122567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:43:06.099887 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-0196372e-4341-4a5d-8f70-e24bea2c31c7 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "GET /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9" status: 404 len: 111 microversion: 2.1 time: 0.031175 Nov 15 12:43:06.100673 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 294/555] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:06 2021] GET /compute/v2.1/servers/d7de1403-72dd-46fd-b7a0-97e4d6c201d9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 15 12:43:06.714036 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-14fdd5f1-b85d-4cbc-92eb-9af65c0f950d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:06.714834 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-14fdd5f1-b85d-4cbc-92eb-9af65c0f950d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:06.721154 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-14fdd5f1-b85d-4cbc-92eb-9af65c0f950d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:06.721600 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-14fdd5f1-b85d-4cbc-92eb-9af65c0f950d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:06.722371 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-14fdd5f1-b85d-4cbc-92eb-9af65c0f950d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:06.722825 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-14fdd5f1-b85d-4cbc-92eb-9af65c0f950d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:06.767644 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-6bf6ec1d-34f5-4476-b16e-7c34fdd8985a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:06.768257 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-6bf6ec1d-34f5-4476-b16e-7c34fdd8985a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:06.774167 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6bf6ec1d-34f5-4476-b16e-7c34fdd8985a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:06.774616 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6bf6ec1d-34f5-4476-b16e-7c34fdd8985a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:06.775425 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6bf6ec1d-34f5-4476-b16e-7c34fdd8985a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:06.775856 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6bf6ec1d-34f5-4476-b16e-7c34fdd8985a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:07.116495 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-14fdd5f1-b85d-4cbc-92eb-9af65c0f950d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:07.126077 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-14fdd5f1-b85d-4cbc-92eb-9af65c0f950d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:07.127680 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-14fdd5f1-b85d-4cbc-92eb-9af65c0f950d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:07.128876 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-14fdd5f1-b85d-4cbc-92eb-9af65c0f950d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1746 microversion: 2.20 time: 0.418575 Nov 15 12:43:07.129441 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 262/556] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:06 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1746 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:07.163159 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-6bf6ec1d-34f5-4476-b16e-7c34fdd8985a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:07.170913 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-6bf6ec1d-34f5-4476-b16e-7c34fdd8985a tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1508 microversion: 2.1 time: 0.406935 Nov 15 12:43:07.171473 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 295/557] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:06 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1508 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:43:08.148246 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-82064158-d0dd-4f29-ab78-5212eab7521a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:08.148830 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-82064158-d0dd-4f29-ab78-5212eab7521a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:08.156055 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-82064158-d0dd-4f29-ab78-5212eab7521a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:08.156499 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-82064158-d0dd-4f29-ab78-5212eab7521a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:08.157283 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-82064158-d0dd-4f29-ab78-5212eab7521a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:08.157712 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-82064158-d0dd-4f29-ab78-5212eab7521a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:08.187988 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-3265b161-76b3-4f09-94db-12cd527e9160 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:08.188592 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-3265b161-76b3-4f09-94db-12cd527e9160 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:08.195016 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3265b161-76b3-4f09-94db-12cd527e9160 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:08.195477 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3265b161-76b3-4f09-94db-12cd527e9160 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:08.196276 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3265b161-76b3-4f09-94db-12cd527e9160 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:08.196717 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3265b161-76b3-4f09-94db-12cd527e9160 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:08.327920 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-82064158-d0dd-4f29-ab78-5212eab7521a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:08.339695 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-82064158-d0dd-4f29-ab78-5212eab7521a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:08.341164 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-82064158-d0dd-4f29-ab78-5212eab7521a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:08.342459 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-82064158-d0dd-4f29-ab78-5212eab7521a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1746 microversion: 2.20 time: 0.197886 Nov 15 12:43:08.343065 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 263/558] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:08 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1746 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:08.375327 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-3265b161-76b3-4f09-94db-12cd527e9160 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:08.382748 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-3265b161-76b3-4f09-94db-12cd527e9160 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1508 microversion: 2.1 time: 0.198362 Nov 15 12:43:08.383418 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 296/559] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:08 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1508 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:09.361028 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-3f334467-72fd-46ef-a8ae-a8c4670a8bc4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:09.361634 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-3f334467-72fd-46ef-a8ae-a8c4670a8bc4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:09.368079 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3f334467-72fd-46ef-a8ae-a8c4670a8bc4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:09.368521 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3f334467-72fd-46ef-a8ae-a8c4670a8bc4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:09.369298 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3f334467-72fd-46ef-a8ae-a8c4670a8bc4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:09.369741 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3f334467-72fd-46ef-a8ae-a8c4670a8bc4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:09.399848 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-c47de264-a0bb-4629-9dbb-df10ae66b7a0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:09.400563 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-c47de264-a0bb-4629-9dbb-df10ae66b7a0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:09.407664 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c47de264-a0bb-4629-9dbb-df10ae66b7a0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:09.408187 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c47de264-a0bb-4629-9dbb-df10ae66b7a0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:09.409035 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c47de264-a0bb-4629-9dbb-df10ae66b7a0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:09.409533 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c47de264-a0bb-4629-9dbb-df10ae66b7a0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:09.532182 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-3f334467-72fd-46ef-a8ae-a8c4670a8bc4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:09.540179 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-3f334467-72fd-46ef-a8ae-a8c4670a8bc4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:09.542589 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-3f334467-72fd-46ef-a8ae-a8c4670a8bc4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:09.543795 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-3f334467-72fd-46ef-a8ae-a8c4670a8bc4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1746 microversion: 2.20 time: 0.186902 Nov 15 12:43:09.544345 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 264/560] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:09 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1746 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:09.575745 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-c47de264-a0bb-4629-9dbb-df10ae66b7a0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:09.582979 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-c47de264-a0bb-4629-9dbb-df10ae66b7a0 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1508 microversion: 2.1 time: 0.186718 Nov 15 12:43:09.583546 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 297/561] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:09 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1508 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:43:10.561453 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-5b602443-1b67-44a4-bf14-48d035c95141 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:10.562050 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-5b602443-1b67-44a4-bf14-48d035c95141 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:10.569027 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5b602443-1b67-44a4-bf14-48d035c95141 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:10.569719 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5b602443-1b67-44a4-bf14-48d035c95141 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:10.570662 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5b602443-1b67-44a4-bf14-48d035c95141 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:10.571277 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5b602443-1b67-44a4-bf14-48d035c95141 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:10.601692 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-7e55666b-ae56-4f10-a06b-cbea9cedf84b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:10.603115 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-7e55666b-ae56-4f10-a06b-cbea9cedf84b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:10.612038 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7e55666b-ae56-4f10-a06b-cbea9cedf84b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:10.612975 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7e55666b-ae56-4f10-a06b-cbea9cedf84b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:10.614002 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7e55666b-ae56-4f10-a06b-cbea9cedf84b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:10.614527 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7e55666b-ae56-4f10-a06b-cbea9cedf84b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:10.862963 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-5b602443-1b67-44a4-bf14-48d035c95141 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:10.872796 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-5b602443-1b67-44a4-bf14-48d035c95141 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:10.874973 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-5b602443-1b67-44a4-bf14-48d035c95141 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:10.876479 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-5b602443-1b67-44a4-bf14-48d035c95141 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1741 microversion: 2.20 time: 0.318828 Nov 15 12:43:10.877450 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 265/562] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:10 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1741 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:10.954600 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-7e55666b-ae56-4f10-a06b-cbea9cedf84b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:10.972005 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-7e55666b-ae56-4f10-a06b-cbea9cedf84b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1508 microversion: 2.1 time: 0.375274 Nov 15 12:43:10.973408 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 298/563] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:10 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1508 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:43:11.384463 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-f4f188c8-caed-4487-88af-edb3d66ea611 req-c3ba8723-fd49-42f9-86b2-951d3a170ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c319b68-dfab-4fb6-99df-31bb18385b5c", "name": "network-vif-deleted", "tag": "f4c16b05-8781-451a-9351-681a5be81f6d"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:43:11.387420 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:43:11.387420 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:43:11.400151 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-f4f188c8-caed-4487-88af-edb3d66ea611 req-c3ba8723-fd49-42f9-86b2-951d3a170ee7 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:11.400629 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-f4f188c8-caed-4487-88af-edb3d66ea611 req-c3ba8723-fd49-42f9-86b2-951d3a170ee7 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:11.412910 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-f4f188c8-caed-4487-88af-edb3d66ea611 req-c3ba8723-fd49-42f9-86b2-951d3a170ee7 service nova] Creating event network-vif-deleted:f4c16b05-8781-451a-9351-681a5be81f6d for instance 3c319b68-dfab-4fb6-99df-31bb18385b5c on hv-cinder-68088 Nov 15 12:43:11.418536 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-f4f188c8-caed-4487-88af-edb3d66ea611 req-c3ba8723-fd49-42f9-86b2-951d3a170ee7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038351 Nov 15 12:43:11.419767 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 266/564] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:43:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:43:11.923256 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-8c784ca6-16b3-4b8e-a654-c7258963697e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:11.924075 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-8c784ca6-16b3-4b8e-a654-c7258963697e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:11.931502 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8c784ca6-16b3-4b8e-a654-c7258963697e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:11.932081 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8c784ca6-16b3-4b8e-a654-c7258963697e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:11.933715 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8c784ca6-16b3-4b8e-a654-c7258963697e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:11.934222 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8c784ca6-16b3-4b8e-a654-c7258963697e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:11.991368 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-f6ff135e-2dc2-4d5b-840b-31549f03520d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:11.992713 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-f6ff135e-2dc2-4d5b-840b-31549f03520d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:12.012030 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f6ff135e-2dc2-4d5b-840b-31549f03520d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:12.012688 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f6ff135e-2dc2-4d5b-840b-31549f03520d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:12.013489 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f6ff135e-2dc2-4d5b-840b-31549f03520d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:12.013921 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f6ff135e-2dc2-4d5b-840b-31549f03520d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:12.100359 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f6ff135e-2dc2-4d5b-840b-31549f03520d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:12.100789 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f6ff135e-2dc2-4d5b-840b-31549f03520d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:12.109457 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.objects.instance [None req-f6ff135e-2dc2-4d5b-840b-31549f03520d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lazy-loading 'fault' on Instance uuid 3c319b68-dfab-4fb6-99df-31bb18385b5c {{(pid=122568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 15 12:43:12.172121 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-f6ff135e-2dc2-4d5b-840b-31549f03520d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:12.179647 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-f6ff135e-2dc2-4d5b-840b-31549f03520d tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 200 len: 1312 microversion: 2.1 time: 0.193425 Nov 15 12:43:12.187488 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 267/565] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:11 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 1312 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:43:12.220029 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-8c784ca6-16b3-4b8e-a654-c7258963697e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:12.230727 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-8c784ca6-16b3-4b8e-a654-c7258963697e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:12.233663 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-8c784ca6-16b3-4b8e-a654-c7258963697e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:12.234884 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-8c784ca6-16b3-4b8e-a654-c7258963697e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1741 microversion: 2.20 time: 0.318551 Nov 15 12:43:12.247645 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 299/566] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:11 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1741 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:12.259957 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-20a90007-638d-4348-823f-2915a9ca6141 req-5b0ab70d-6071-4914-9b2f-55b808533290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11daa0bc-1e25-47d7-a6df-ffc808e1ff58", "name": "network-vif-plugged", "status": "completed", "tag": "7a90a770-a011-4cb6-9fcf-893773b8d120"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:43:12.262109 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:43:12.262109 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:43:12.271712 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-20a90007-638d-4348-823f-2915a9ca6141 req-5b0ab70d-6071-4914-9b2f-55b808533290 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:12.272812 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-20a90007-638d-4348-823f-2915a9ca6141 req-5b0ab70d-6071-4914-9b2f-55b808533290 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:12.286414 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-20a90007-638d-4348-823f-2915a9ca6141 req-5b0ab70d-6071-4914-9b2f-55b808533290 service nova] Creating event network-vif-plugged:7a90a770-a011-4cb6-9fcf-893773b8d120 for instance 11daa0bc-1e25-47d7-a6df-ffc808e1ff58 on hv-cinder-68088 Nov 15 12:43:12.292769 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-20a90007-638d-4348-823f-2915a9ca6141 req-5b0ab70d-6071-4914-9b2f-55b808533290 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036321 Nov 15 12:43:12.293632 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 268/567] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:43:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:43:13.198664 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-62f2d14f-671d-4dbb-b7b2-f571b59c386f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:13.199601 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-62f2d14f-671d-4dbb-b7b2-f571b59c386f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: 3c319b68-dfab-4fb6-99df-31bb18385b5c] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:13.206102 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-62f2d14f-671d-4dbb-b7b2-f571b59c386f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:13.214968 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-62f2d14f-671d-4dbb-b7b2-f571b59c386f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:13.216178 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-62f2d14f-671d-4dbb-b7b2-f571b59c386f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:13.216640 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-62f2d14f-671d-4dbb-b7b2-f571b59c386f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:13.233477 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.wsgi [None req-62f2d14f-671d-4dbb-b7b2-f571b59c386f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] HTTP exception thrown: Instance 3c319b68-dfab-4fb6-99df-31bb18385b5c could not be found. Nov 15 12:43:13.234080 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-62f2d14f-671d-4dbb-b7b2-f571b59c386f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Returning 404 to user: Instance 3c319b68-dfab-4fb6-99df-31bb18385b5c could not be found. {{(pid=122567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:43:13.234960 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-62f2d14f-671d-4dbb-b7b2-f571b59c386f tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c" status: 404 len: 111 microversion: 2.1 time: 0.040344 Nov 15 12:43:13.235523 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 300/568] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:13 2021] GET /compute/v2.1/servers/3c319b68-dfab-4fb6-99df-31bb18385b5c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 15 12:43:13.244760 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-6b63cf50-f818-41d8-b11a-0275ce105410 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:13.245926 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-6b63cf50-f818-41d8-b11a-0275ce105410 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:13.253656 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-2adaa9a7-d38b-47bb-8920-26bd8f16120c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:13.254398 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-2adaa9a7-d38b-47bb-8920-26bd8f16120c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:13.256730 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6b63cf50-f818-41d8-b11a-0275ce105410 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:13.257160 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6b63cf50-f818-41d8-b11a-0275ce105410 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:13.258123 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6b63cf50-f818-41d8-b11a-0275ce105410 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:13.258548 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6b63cf50-f818-41d8-b11a-0275ce105410 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:13.263769 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2adaa9a7-d38b-47bb-8920-26bd8f16120c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:13.264354 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2adaa9a7-d38b-47bb-8920-26bd8f16120c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:13.265154 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2adaa9a7-d38b-47bb-8920-26bd8f16120c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:13.265596 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2adaa9a7-d38b-47bb-8920-26bd8f16120c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:13.296125 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-6b63cf50-f818-41d8-b11a-0275ce105410 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Going to try to terminate instance {{(pid=122568) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 15 12:43:13.421268 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-6b63cf50-f818-41d8-b11a-0275ce105410 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "DELETE /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 204 len: 0 microversion: 2.1 time: 0.180377 Nov 15 12:43:13.422853 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 269/569] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Nov 15 12:43:13 2021] DELETE /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 15 12:43:13.431535 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-1f2acf41-1ab5-45b3-b573-abf0657a7c3b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:13.432515 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-1f2acf41-1ab5-45b3-b573-abf0657a7c3b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:13.436911 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-2adaa9a7-d38b-47bb-8920-26bd8f16120c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:13.439883 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1f2acf41-1ab5-45b3-b573-abf0657a7c3b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:13.440322 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1f2acf41-1ab5-45b3-b573-abf0657a7c3b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:13.441101 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1f2acf41-1ab5-45b3-b573-abf0657a7c3b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:13.441519 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1f2acf41-1ab5-45b3-b573-abf0657a7c3b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:13.448216 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-2adaa9a7-d38b-47bb-8920-26bd8f16120c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:13.453213 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-2adaa9a7-d38b-47bb-8920-26bd8f16120c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:13.454533 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-2adaa9a7-d38b-47bb-8920-26bd8f16120c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1741 microversion: 2.20 time: 0.204906 Nov 15 12:43:13.466363 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 301/570] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:13 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1741 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:13.599012 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-1f2acf41-1ab5-45b3-b573-abf0657a7c3b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:13.608862 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-1f2acf41-1ab5-45b3-b573-abf0657a7c3b tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1521 microversion: 2.1 time: 0.181466 Nov 15 12:43:13.609645 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 270/571] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:13 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:14.473532 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-68674809-f3fc-4ed7-bb86-f29571ffdc9f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:14.474123 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-68674809-f3fc-4ed7-bb86-f29571ffdc9f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:14.480686 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-68674809-f3fc-4ed7-bb86-f29571ffdc9f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:14.481403 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-68674809-f3fc-4ed7-bb86-f29571ffdc9f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:14.482547 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-68674809-f3fc-4ed7-bb86-f29571ffdc9f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:14.483064 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-68674809-f3fc-4ed7-bb86-f29571ffdc9f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:14.626412 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-a19d28e6-b3da-4f49-8c05-3a888ee1c6f6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:14.627116 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-a19d28e6-b3da-4f49-8c05-3a888ee1c6f6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:14.639549 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a19d28e6-b3da-4f49-8c05-3a888ee1c6f6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:14.640059 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a19d28e6-b3da-4f49-8c05-3a888ee1c6f6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:14.643246 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-68674809-f3fc-4ed7-bb86-f29571ffdc9f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:14.651655 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-68674809-f3fc-4ed7-bb86-f29571ffdc9f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:14.654915 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a19d28e6-b3da-4f49-8c05-3a888ee1c6f6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:14.655510 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a19d28e6-b3da-4f49-8c05-3a888ee1c6f6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:14.656899 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-68674809-f3fc-4ed7-bb86-f29571ffdc9f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:14.658219 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-68674809-f3fc-4ed7-bb86-f29571ffdc9f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1741 microversion: 2.20 time: 0.188635 Nov 15 12:43:14.662329 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 302/572] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:14 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1741 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:14.810965 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-a19d28e6-b3da-4f49-8c05-3a888ee1c6f6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:14.819239 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-a19d28e6-b3da-4f49-8c05-3a888ee1c6f6 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1521 microversion: 2.1 time: 0.196309 Nov 15 12:43:14.820001 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 271/573] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:14 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:15.677073 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-558c3905-a1bc-4f5d-b48a-ce572aeb8ddb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:15.677840 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-558c3905-a1bc-4f5d-b48a-ce572aeb8ddb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:15.687822 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-558c3905-a1bc-4f5d-b48a-ce572aeb8ddb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:15.688556 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-558c3905-a1bc-4f5d-b48a-ce572aeb8ddb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:15.689511 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-558c3905-a1bc-4f5d-b48a-ce572aeb8ddb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:15.689939 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-558c3905-a1bc-4f5d-b48a-ce572aeb8ddb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:15.837267 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-b12da143-b8a6-44bf-9378-1ad6080520e1 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:15.837838 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-b12da143-b8a6-44bf-9378-1ad6080520e1 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:15.841115 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-558c3905-a1bc-4f5d-b48a-ce572aeb8ddb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:15.844950 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b12da143-b8a6-44bf-9378-1ad6080520e1 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:15.845386 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b12da143-b8a6-44bf-9378-1ad6080520e1 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:15.846436 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b12da143-b8a6-44bf-9378-1ad6080520e1 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:15.846879 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b12da143-b8a6-44bf-9378-1ad6080520e1 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:15.849445 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-558c3905-a1bc-4f5d-b48a-ce572aeb8ddb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:15.852699 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-558c3905-a1bc-4f5d-b48a-ce572aeb8ddb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:15.853077 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-558c3905-a1bc-4f5d-b48a-ce572aeb8ddb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1741 microversion: 2.20 time: 0.179518 Nov 15 12:43:15.865151 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 303/574] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:15 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1741 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:16.010158 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-b12da143-b8a6-44bf-9378-1ad6080520e1 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:16.019237 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-b12da143-b8a6-44bf-9378-1ad6080520e1 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1521 microversion: 2.1 time: 0.185715 Nov 15 12:43:16.020009 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 272/575] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:15 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:43:16.049930 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-93fffb7e-ed17-43c6-80ec-1598836717f8 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1776592798", "imageRef": "3cc21e2c-27da-4266-be76-369023341c16", "flavorRef": "452", "networks": [{"uuid": "b79f49ef-73b5-4352-9d73-84333759f64b"}]}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:43:16.106668 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.network.neutron [None req-93fffb7e-ed17-43c6-80ec-1598836717f8 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] validate_networks() for [('b79f49ef-73b5-4352-9d73-84333759f64b', None, None, None, None, None)] {{(pid=122567) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 15 12:43:16.566798 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-93fffb7e-ed17-43c6-80ec-1598836717f8 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Flavor limits 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 15 12:43:16.567238 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-93fffb7e-ed17-43c6-80ec-1598836717f8 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Image limits 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 15 12:43:16.567708 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-93fffb7e-ed17-43c6-80ec-1598836717f8 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Flavor pref 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 15 12:43:16.568115 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-93fffb7e-ed17-43c6-80ec-1598836717f8 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Image pref 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 15 12:43:16.568735 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-93fffb7e-ed17-43c6-80ec-1598836717f8 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 15 12:43:16.578754 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-93fffb7e-ed17-43c6-80ec-1598836717f8 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:16.579228 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-93fffb7e-ed17-43c6-80ec-1598836717f8 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:16.580045 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-93fffb7e-ed17-43c6-80ec-1598836717f8 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:16.580479 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-93fffb7e-ed17-43c6-80ec-1598836717f8 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:16.600168 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.quota [None req-93fffb7e-ed17-43c6-80ec-1598836717f8 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Getting quotas for project 3aae5c632c8b4d4f94206b1d6745c0ba. Resources: {'cores', 'ram', 'instances'} {{(pid=122567) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:43:16.608187 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.quota [None req-93fffb7e-ed17-43c6-80ec-1598836717f8 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Getting quotas for user a44c99bd2e434807b12facc77f18a5cf and project 3aae5c632c8b4d4f94206b1d6745c0ba. Resources: {'cores', 'ram', 'instances'} {{(pid=122567) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:43:16.623662 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-93fffb7e-ed17-43c6-80ec-1598836717f8 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Going to run 1 instances... {{(pid=122567) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 15 12:43:16.626052 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-93fffb7e-ed17-43c6-80ec-1598836717f8 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: ec023efe-8c28-4d57-a7a1-eb10caa7a723] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3cc21e2c-27da-4266-be76-369023341c16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 15 12:43:16.716800 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-93fffb7e-ed17-43c6-80ec-1598836717f8 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.671019 Nov 15 12:43:16.717806 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 304/576] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Nov 15 12:43:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 15 12:43:16.727081 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-d90ef7d3-0ac2-40f9-9cd0-40200adc14dc tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:16.728261 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-d90ef7d3-0ac2-40f9-9cd0-40200adc14dc tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: ec023efe-8c28-4d57-a7a1-eb10caa7a723] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:16.803597 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-d90ef7d3-0ac2-40f9-9cd0-40200adc14dc tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44c99bd2e434807b12facc77f18a5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aae5c632c8b4d4f94206b1d6745c0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:16.811489 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-d90ef7d3-0ac2-40f9-9cd0-40200adc14dc tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "GET /compute/v2.1/servers/ec023efe-8c28-4d57-a7a1-eb10caa7a723" status: 200 len: 1219 microversion: 2.1 time: 0.087859 Nov 15 12:43:16.812807 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 273/577] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:16 2021] GET /compute/v2.1/servers/ec023efe-8c28-4d57-a7a1-eb10caa7a723 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:16.873215 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-b1fa1339-68db-4f22-9e3c-45beaee53a28 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:16.874105 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-b1fa1339-68db-4f22-9e3c-45beaee53a28 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:16.881188 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b1fa1339-68db-4f22-9e3c-45beaee53a28 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:16.882015 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b1fa1339-68db-4f22-9e3c-45beaee53a28 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:16.883048 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b1fa1339-68db-4f22-9e3c-45beaee53a28 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:16.883706 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b1fa1339-68db-4f22-9e3c-45beaee53a28 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:17.037500 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-70223971-889a-4ec6-bb20-11617eb3b943 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:17.038204 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-70223971-889a-4ec6-bb20-11617eb3b943 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:17.047884 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-70223971-889a-4ec6-bb20-11617eb3b943 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:17.052088 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-70223971-889a-4ec6-bb20-11617eb3b943 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:17.053979 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-70223971-889a-4ec6-bb20-11617eb3b943 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:17.055856 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-70223971-889a-4ec6-bb20-11617eb3b943 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:17.078955 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-b1fa1339-68db-4f22-9e3c-45beaee53a28 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:17.088337 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-b1fa1339-68db-4f22-9e3c-45beaee53a28 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:17.092084 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-b1fa1339-68db-4f22-9e3c-45beaee53a28 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:17.093731 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-b1fa1339-68db-4f22-9e3c-45beaee53a28 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1741 microversion: 2.20 time: 0.225457 Nov 15 12:43:17.094960 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 305/578] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:16 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1741 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:17.243309 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-70223971-889a-4ec6-bb20-11617eb3b943 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:17.252368 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-70223971-889a-4ec6-bb20-11617eb3b943 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1521 microversion: 2.1 time: 0.219409 Nov 15 12:43:17.253590 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 274/579] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:17 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:43:17.829853 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-fcffbbf2-797b-41b7-9601-311e57034aeb tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:17.831359 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-fcffbbf2-797b-41b7-9601-311e57034aeb tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: ec023efe-8c28-4d57-a7a1-eb10caa7a723] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:17.838015 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-fcffbbf2-797b-41b7-9601-311e57034aeb tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:17.839286 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-fcffbbf2-797b-41b7-9601-311e57034aeb tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:17.840247 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-fcffbbf2-797b-41b7-9601-311e57034aeb tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:17.840833 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-fcffbbf2-797b-41b7-9601-311e57034aeb tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:17.909867 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-fcffbbf2-797b-41b7-9601-311e57034aeb tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44c99bd2e434807b12facc77f18a5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aae5c632c8b4d4f94206b1d6745c0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:17.918222 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-fcffbbf2-797b-41b7-9601-311e57034aeb tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "GET /compute/v2.1/servers/ec023efe-8c28-4d57-a7a1-eb10caa7a723" status: 200 len: 1271 microversion: 2.1 time: 0.091897 Nov 15 12:43:17.928541 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 306/580] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:17 2021] GET /compute/v2.1/servers/ec023efe-8c28-4d57-a7a1-eb10caa7a723 => generated 1271 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:18.113201 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-b2d4e09c-373d-479a-a1f5-f8d7bf5f3801 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:18.114413 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-b2d4e09c-373d-479a-a1f5-f8d7bf5f3801 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:18.124096 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b2d4e09c-373d-479a-a1f5-f8d7bf5f3801 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:18.125251 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b2d4e09c-373d-479a-a1f5-f8d7bf5f3801 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:18.132629 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b2d4e09c-373d-479a-a1f5-f8d7bf5f3801 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:18.133085 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b2d4e09c-373d-479a-a1f5-f8d7bf5f3801 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:18.274630 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-afb30714-8913-43bc-972c-3d001e5b7ffb tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:18.275652 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-afb30714-8913-43bc-972c-3d001e5b7ffb tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:18.283895 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-afb30714-8913-43bc-972c-3d001e5b7ffb tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:18.284529 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-afb30714-8913-43bc-972c-3d001e5b7ffb tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:18.285515 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-afb30714-8913-43bc-972c-3d001e5b7ffb tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:18.286105 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-afb30714-8913-43bc-972c-3d001e5b7ffb tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:18.443999 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-b2d4e09c-373d-479a-a1f5-f8d7bf5f3801 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:18.452844 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-b2d4e09c-373d-479a-a1f5-f8d7bf5f3801 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:18.454499 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-b2d4e09c-373d-479a-a1f5-f8d7bf5f3801 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:18.459591 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-b2d4e09c-373d-479a-a1f5-f8d7bf5f3801 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1741 microversion: 2.20 time: 0.350196 Nov 15 12:43:18.472151 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 275/581] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:18 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1741 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:18.569879 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-afb30714-8913-43bc-972c-3d001e5b7ffb tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:18.587541 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-afb30714-8913-43bc-972c-3d001e5b7ffb tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1521 microversion: 2.1 time: 0.318410 Nov 15 12:43:18.589721 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 307/582] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:18 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:43:18.937375 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-50ec249f-20f3-4348-9dbb-cbaa83cafc96 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:18.938335 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-50ec249f-20f3-4348-9dbb-cbaa83cafc96 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: ec023efe-8c28-4d57-a7a1-eb10caa7a723] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:18.949851 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-50ec249f-20f3-4348-9dbb-cbaa83cafc96 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:18.951239 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-50ec249f-20f3-4348-9dbb-cbaa83cafc96 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:18.952261 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-50ec249f-20f3-4348-9dbb-cbaa83cafc96 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:18.952787 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-50ec249f-20f3-4348-9dbb-cbaa83cafc96 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:19.227679 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-50ec249f-20f3-4348-9dbb-cbaa83cafc96 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44c99bd2e434807b12facc77f18a5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aae5c632c8b4d4f94206b1d6745c0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:19.237056 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-50ec249f-20f3-4348-9dbb-cbaa83cafc96 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "GET /compute/v2.1/servers/ec023efe-8c28-4d57-a7a1-eb10caa7a723" status: 200 len: 1319 microversion: 2.1 time: 0.304679 Nov 15 12:43:19.237961 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 276/583] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:18 2021] GET /compute/v2.1/servers/ec023efe-8c28-4d57-a7a1-eb10caa7a723 => generated 1319 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:19.478624 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e5e4657c-8505-48dd-8b71-5b6c89296640 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:19.479731 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e5e4657c-8505-48dd-8b71-5b6c89296640 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:19.491833 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e5e4657c-8505-48dd-8b71-5b6c89296640 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:19.492287 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e5e4657c-8505-48dd-8b71-5b6c89296640 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:19.497030 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e5e4657c-8505-48dd-8b71-5b6c89296640 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:19.497596 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e5e4657c-8505-48dd-8b71-5b6c89296640 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:19.605878 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-36f7ad8b-34bc-40e5-adfa-9b175d964173 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:19.606494 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-36f7ad8b-34bc-40e5-adfa-9b175d964173 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:19.625035 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-36f7ad8b-34bc-40e5-adfa-9b175d964173 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:19.625478 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-36f7ad8b-34bc-40e5-adfa-9b175d964173 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:19.626277 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-36f7ad8b-34bc-40e5-adfa-9b175d964173 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:19.626734 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-36f7ad8b-34bc-40e5-adfa-9b175d964173 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:19.806970 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e5e4657c-8505-48dd-8b71-5b6c89296640 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:19.818370 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e5e4657c-8505-48dd-8b71-5b6c89296640 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:19.820114 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e5e4657c-8505-48dd-8b71-5b6c89296640 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:19.821770 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e5e4657c-8505-48dd-8b71-5b6c89296640 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1741 microversion: 2.20 time: 0.347212 Nov 15 12:43:19.834873 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 308/584] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:19 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1741 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:19.922560 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-36f7ad8b-34bc-40e5-adfa-9b175d964173 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:19.931180 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-36f7ad8b-34bc-40e5-adfa-9b175d964173 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1521 microversion: 2.1 time: 0.329447 Nov 15 12:43:19.933078 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 277/585] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:19 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:20.090505 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [req-313b1f66-cda8-4efb-ae43-ee01ec09998d req-23c20d86-296f-4251-b164-8549ea69d309 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec023efe-8c28-4d57-a7a1-eb10caa7a723", "tag": "fb7fc7e4-f6f7-4eb4-b137-cfec4ac39bd8"}]} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:43:20.092886 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:43:20.092886 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: warnings.warn(msg) Nov 15 12:43:20.118859 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-313b1f66-cda8-4efb-ae43-ee01ec09998d req-23c20d86-296f-4251-b164-8549ea69d309 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:20.120794 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-313b1f66-cda8-4efb-ae43-ee01ec09998d req-23c20d86-296f-4251-b164-8549ea69d309 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:20.133889 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.compute.server_external_events [req-313b1f66-cda8-4efb-ae43-ee01ec09998d req-23c20d86-296f-4251-b164-8549ea69d309 service nova] Creating event network-changed:fb7fc7e4-f6f7-4eb4-b137-cfec4ac39bd8 for instance ec023efe-8c28-4d57-a7a1-eb10caa7a723 on hv-cinder-68088 Nov 15 12:43:20.144915 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [req-313b1f66-cda8-4efb-ae43-ee01ec09998d req-23c20d86-296f-4251-b164-8549ea69d309 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060934 Nov 15 12:43:20.145823 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 309/586] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:43:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:43:20.255018 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-d577c7da-bd9f-47b3-b7c8-eab13ab3071b tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:20.257027 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-d577c7da-bd9f-47b3-b7c8-eab13ab3071b tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: ec023efe-8c28-4d57-a7a1-eb10caa7a723] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:20.264874 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d577c7da-bd9f-47b3-b7c8-eab13ab3071b tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:20.265598 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d577c7da-bd9f-47b3-b7c8-eab13ab3071b tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:20.266877 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d577c7da-bd9f-47b3-b7c8-eab13ab3071b tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:20.267759 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d577c7da-bd9f-47b3-b7c8-eab13ab3071b tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:20.502543 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-d577c7da-bd9f-47b3-b7c8-eab13ab3071b tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44c99bd2e434807b12facc77f18a5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aae5c632c8b4d4f94206b1d6745c0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:20.512785 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-d577c7da-bd9f-47b3-b7c8-eab13ab3071b tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "GET /compute/v2.1/servers/ec023efe-8c28-4d57-a7a1-eb10caa7a723" status: 200 len: 1319 microversion: 2.1 time: 0.261364 Nov 15 12:43:20.513379 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 278/587] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:20 2021] GET /compute/v2.1/servers/ec023efe-8c28-4d57-a7a1-eb10caa7a723 => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:20.843149 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-73ffdb0f-86b5-491f-bdc3-6233ba5ab3cf tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:20.844014 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-73ffdb0f-86b5-491f-bdc3-6233ba5ab3cf tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:20.850868 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-73ffdb0f-86b5-491f-bdc3-6233ba5ab3cf tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:20.851249 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-73ffdb0f-86b5-491f-bdc3-6233ba5ab3cf tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:20.852048 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-73ffdb0f-86b5-491f-bdc3-6233ba5ab3cf tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:20.852483 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-73ffdb0f-86b5-491f-bdc3-6233ba5ab3cf tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:20.953149 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-d9ca1a3a-9208-497c-abf2-1b445e278ada tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:20.953765 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-d9ca1a3a-9208-497c-abf2-1b445e278ada tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:20.960174 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d9ca1a3a-9208-497c-abf2-1b445e278ada tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:20.960631 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d9ca1a3a-9208-497c-abf2-1b445e278ada tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:20.961418 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d9ca1a3a-9208-497c-abf2-1b445e278ada tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:20.961850 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d9ca1a3a-9208-497c-abf2-1b445e278ada tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:20.990595 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-73ffdb0f-86b5-491f-bdc3-6233ba5ab3cf tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:20.999335 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-73ffdb0f-86b5-491f-bdc3-6233ba5ab3cf tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:21.000843 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-73ffdb0f-86b5-491f-bdc3-6233ba5ab3cf tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:21.001999 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-73ffdb0f-86b5-491f-bdc3-6233ba5ab3cf tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1741 microversion: 2.20 time: 0.163809 Nov 15 12:43:21.002558 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 310/588] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:20 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1741 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:21.092924 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-d9ca1a3a-9208-497c-abf2-1b445e278ada tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:21.100267 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-d9ca1a3a-9208-497c-abf2-1b445e278ada tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1521 microversion: 2.1 time: 0.150923 Nov 15 12:43:21.100841 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 279/589] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:20 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:43:21.529750 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e4a0b318-6b5e-44a8-8178-feaf00f73d62 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:21.530368 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e4a0b318-6b5e-44a8-8178-feaf00f73d62 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: ec023efe-8c28-4d57-a7a1-eb10caa7a723] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:21.536245 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e4a0b318-6b5e-44a8-8178-feaf00f73d62 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:21.536694 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e4a0b318-6b5e-44a8-8178-feaf00f73d62 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:21.537475 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e4a0b318-6b5e-44a8-8178-feaf00f73d62 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:21.537907 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e4a0b318-6b5e-44a8-8178-feaf00f73d62 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:21.750913 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e4a0b318-6b5e-44a8-8178-feaf00f73d62 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44c99bd2e434807b12facc77f18a5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aae5c632c8b4d4f94206b1d6745c0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:21.759056 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e4a0b318-6b5e-44a8-8178-feaf00f73d62 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "GET /compute/v2.1/servers/ec023efe-8c28-4d57-a7a1-eb10caa7a723" status: 200 len: 1319 microversion: 2.1 time: 0.233235 Nov 15 12:43:21.759634 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 311/590] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:21 2021] GET /compute/v2.1/servers/ec023efe-8c28-4d57-a7a1-eb10caa7a723 => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:22.021200 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-39b82657-8c6c-4602-92bb-e7e2448c479d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:22.022429 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-39b82657-8c6c-4602-92bb-e7e2448c479d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:22.029944 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-39b82657-8c6c-4602-92bb-e7e2448c479d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:22.030395 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-39b82657-8c6c-4602-92bb-e7e2448c479d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:22.031268 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-39b82657-8c6c-4602-92bb-e7e2448c479d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:22.031705 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-39b82657-8c6c-4602-92bb-e7e2448c479d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:22.117255 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-9c74e55b-e60c-4e2d-b30e-b5bccdb1435e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:22.118043 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-9c74e55b-e60c-4e2d-b30e-b5bccdb1435e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:22.125278 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9c74e55b-e60c-4e2d-b30e-b5bccdb1435e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:22.126847 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9c74e55b-e60c-4e2d-b30e-b5bccdb1435e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:22.127893 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9c74e55b-e60c-4e2d-b30e-b5bccdb1435e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:22.128550 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9c74e55b-e60c-4e2d-b30e-b5bccdb1435e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:22.306189 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-39b82657-8c6c-4602-92bb-e7e2448c479d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:22.314310 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-39b82657-8c6c-4602-92bb-e7e2448c479d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:22.315836 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-39b82657-8c6c-4602-92bb-e7e2448c479d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:22.316998 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-39b82657-8c6c-4602-92bb-e7e2448c479d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1723 microversion: 2.20 time: 0.300473 Nov 15 12:43:22.317737 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 280/591] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:22 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1723 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 15 12:43:22.380587 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-9c74e55b-e60c-4e2d-b30e-b5bccdb1435e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77087092d5b44e0b865de65e33e12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b782e267fb414c9bdfa078a438871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:22.388013 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-9c74e55b-e60c-4e2d-b30e-b5bccdb1435e tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 200 len: 1521 microversion: 2.1 time: 0.274378 Nov 15 12:43:22.389164 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 312/592] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:22 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:43:22.437385 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-5af53fc4-08f8-4d37-a20a-bb15f24194de req-08b9c00f-a318-4383-a73b-d80d99034e80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aea00c4f-da8f-4b9e-8c12-7ebe91776986", "name": "network-vif-deleted", "tag": "15072390-eca0-4c84-8a3a-2ea1b15c4f44"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:43:22.440483 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:43:22.440483 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:43:22.449191 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-5af53fc4-08f8-4d37-a20a-bb15f24194de req-08b9c00f-a318-4383-a73b-d80d99034e80 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:22.449628 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-5af53fc4-08f8-4d37-a20a-bb15f24194de req-08b9c00f-a318-4383-a73b-d80d99034e80 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:22.460599 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-5af53fc4-08f8-4d37-a20a-bb15f24194de req-08b9c00f-a318-4383-a73b-d80d99034e80 service nova] Creating event network-vif-deleted:15072390-eca0-4c84-8a3a-2ea1b15c4f44 for instance aea00c4f-da8f-4b9e-8c12-7ebe91776986 on hv-cinder-68088 Nov 15 12:43:22.466504 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-5af53fc4-08f8-4d37-a20a-bb15f24194de req-08b9c00f-a318-4383-a73b-d80d99034e80 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032593 Nov 15 12:43:22.467131 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 281/593] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:43:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:43:22.776725 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-6ab82135-faf7-4f3f-8c33-4534667a361d tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:22.777346 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-6ab82135-faf7-4f3f-8c33-4534667a361d tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: ec023efe-8c28-4d57-a7a1-eb10caa7a723] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:22.783414 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6ab82135-faf7-4f3f-8c33-4534667a361d tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:22.783864 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6ab82135-faf7-4f3f-8c33-4534667a361d tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:22.784640 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6ab82135-faf7-4f3f-8c33-4534667a361d tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:22.785068 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6ab82135-faf7-4f3f-8c33-4534667a361d tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:22.923229 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-6ab82135-faf7-4f3f-8c33-4534667a361d tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44c99bd2e434807b12facc77f18a5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aae5c632c8b4d4f94206b1d6745c0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:22.930737 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-6ab82135-faf7-4f3f-8c33-4534667a361d tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "GET /compute/v2.1/servers/ec023efe-8c28-4d57-a7a1-eb10caa7a723" status: 200 len: 1319 microversion: 2.1 time: 0.158263 Nov 15 12:43:22.938817 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 313/594] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:22 2021] GET /compute/v2.1/servers/ec023efe-8c28-4d57-a7a1-eb10caa7a723 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:23.337672 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-ad34bd77-919c-4cfa-8ad4-b0a9761fbd3e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:23.338301 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-ad34bd77-919c-4cfa-8ad4-b0a9761fbd3e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:23.345160 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ad34bd77-919c-4cfa-8ad4-b0a9761fbd3e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:23.345628 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ad34bd77-919c-4cfa-8ad4-b0a9761fbd3e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:23.346410 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ad34bd77-919c-4cfa-8ad4-b0a9761fbd3e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:23.346875 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ad34bd77-919c-4cfa-8ad4-b0a9761fbd3e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:23.405540 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-adabf495-8031-47d2-b7df-bb94f6adc264 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:23.406140 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-adabf495-8031-47d2-b7df-bb94f6adc264 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] [instance: aea00c4f-da8f-4b9e-8c12-7ebe91776986] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:23.412563 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-adabf495-8031-47d2-b7df-bb94f6adc264 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:23.413004 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-adabf495-8031-47d2-b7df-bb94f6adc264 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:23.413774 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-adabf495-8031-47d2-b7df-bb94f6adc264 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:23.414201 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-adabf495-8031-47d2-b7df-bb94f6adc264 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:23.428272 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.wsgi [None req-adabf495-8031-47d2-b7df-bb94f6adc264 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] HTTP exception thrown: Instance aea00c4f-da8f-4b9e-8c12-7ebe91776986 could not be found. Nov 15 12:43:23.428862 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-adabf495-8031-47d2-b7df-bb94f6adc264 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] Returning 404 to user: Instance aea00c4f-da8f-4b9e-8c12-7ebe91776986 could not be found. {{(pid=122567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:43:23.429687 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-adabf495-8031-47d2-b7df-bb94f6adc264 tempest-ServerRescueNegativeTestJSON-1561129504 tempest-ServerRescueNegativeTestJSON-1561129504-project] 10.222.0.43 "GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986" status: 404 len: 111 microversion: 2.1 time: 0.028382 Nov 15 12:43:23.430235 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 314/595] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:23 2021] GET /compute/v2.1/servers/aea00c4f-da8f-4b9e-8c12-7ebe91776986 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 15 12:43:23.483856 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-ad34bd77-919c-4cfa-8ad4-b0a9761fbd3e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:23.493592 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-ad34bd77-919c-4cfa-8ad4-b0a9761fbd3e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:23.495878 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-ad34bd77-919c-4cfa-8ad4-b0a9761fbd3e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:23.497036 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-ad34bd77-919c-4cfa-8ad4-b0a9761fbd3e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1723 microversion: 2.20 time: 0.163519 Nov 15 12:43:23.497597 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 282/596] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:23 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:23.946966 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-98339bf4-69df-490a-9642-7c76e53d9a42 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:23.947563 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-98339bf4-69df-490a-9642-7c76e53d9a42 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: ec023efe-8c28-4d57-a7a1-eb10caa7a723] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:23.953899 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-98339bf4-69df-490a-9642-7c76e53d9a42 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:23.954341 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-98339bf4-69df-490a-9642-7c76e53d9a42 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:23.955136 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-98339bf4-69df-490a-9642-7c76e53d9a42 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:23.955563 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-98339bf4-69df-490a-9642-7c76e53d9a42 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:24.090698 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-98339bf4-69df-490a-9642-7c76e53d9a42 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44c99bd2e434807b12facc77f18a5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aae5c632c8b4d4f94206b1d6745c0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:24.098290 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-98339bf4-69df-490a-9642-7c76e53d9a42 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "GET /compute/v2.1/servers/ec023efe-8c28-4d57-a7a1-eb10caa7a723" status: 200 len: 1319 microversion: 2.1 time: 0.154811 Nov 15 12:43:24.098861 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 315/597] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:23 2021] GET /compute/v2.1/servers/ec023efe-8c28-4d57-a7a1-eb10caa7a723 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:24.515787 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-eb1544f3-8940-4cdb-8462-f60cfe91ac9d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:24.516391 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-eb1544f3-8940-4cdb-8462-f60cfe91ac9d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:24.522825 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-eb1544f3-8940-4cdb-8462-f60cfe91ac9d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:24.523343 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-eb1544f3-8940-4cdb-8462-f60cfe91ac9d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:24.524184 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-eb1544f3-8940-4cdb-8462-f60cfe91ac9d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:24.524610 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-eb1544f3-8940-4cdb-8462-f60cfe91ac9d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:24.661981 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-eb1544f3-8940-4cdb-8462-f60cfe91ac9d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:24.670581 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-eb1544f3-8940-4cdb-8462-f60cfe91ac9d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:24.672102 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-eb1544f3-8940-4cdb-8462-f60cfe91ac9d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:24.673512 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-eb1544f3-8940-4cdb-8462-f60cfe91ac9d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1726 microversion: 2.20 time: 0.161398 Nov 15 12:43:24.674071 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 283/598] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:24 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:24.691269 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-b0d4cb3f-bd6d-43d2-a311-a0b8783b1619 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9dc2606b-2e79-4ecd-a1f6-1cb1c57a75b8"}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:43:24.692486 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-b0d4cb3f-bd6d-43d2-a311-a0b8783b1619 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:24.699336 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b0d4cb3f-bd6d-43d2-a311-a0b8783b1619 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:24.699880 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b0d4cb3f-bd6d-43d2-a311-a0b8783b1619 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:24.700725 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b0d4cb3f-bd6d-43d2-a311-a0b8783b1619 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:24.701229 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b0d4cb3f-bd6d-43d2-a311-a0b8783b1619 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:25.008842 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-b0d4cb3f-bd6d-43d2-a311-a0b8783b1619 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.321071 Nov 15 12:43:25.016076 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 316/599] 10.222.0.43 () {62 vars in 1363 bytes} [Mon Nov 15 12:43:24 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/os-volume_attachments => generated 188 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:43:25.103775 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-faa6330f-d269-4a34-8c14-e122ec9b755c req-a9c938ee-f230-488f-927e-a6a8274fd4ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec023efe-8c28-4d57-a7a1-eb10caa7a723", "name": "network-vif-plugged", "status": "completed", "tag": "fb7fc7e4-f6f7-4eb4-b137-cfec4ac39bd8"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:43:25.107477 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:43:25.107477 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:43:25.116002 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-780fdbf7-b4b7-4c16-912d-1bb4fc8025b4 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:25.117296 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-780fdbf7-b4b7-4c16-912d-1bb4fc8025b4 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: ec023efe-8c28-4d57-a7a1-eb10caa7a723] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:25.133874 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-780fdbf7-b4b7-4c16-912d-1bb4fc8025b4 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:25.137023 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-faa6330f-d269-4a34-8c14-e122ec9b755c req-a9c938ee-f230-488f-927e-a6a8274fd4ef service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:25.137897 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-faa6330f-d269-4a34-8c14-e122ec9b755c req-a9c938ee-f230-488f-927e-a6a8274fd4ef service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:25.138715 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-780fdbf7-b4b7-4c16-912d-1bb4fc8025b4 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:25.141785 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-780fdbf7-b4b7-4c16-912d-1bb4fc8025b4 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:25.144085 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-780fdbf7-b4b7-4c16-912d-1bb4fc8025b4 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:25.177086 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-faa6330f-d269-4a34-8c14-e122ec9b755c req-a9c938ee-f230-488f-927e-a6a8274fd4ef service nova] Creating event network-vif-plugged:fb7fc7e4-f6f7-4eb4-b137-cfec4ac39bd8 for instance ec023efe-8c28-4d57-a7a1-eb10caa7a723 on hv-cinder-68088 Nov 15 12:43:25.190314 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-faa6330f-d269-4a34-8c14-e122ec9b755c req-a9c938ee-f230-488f-927e-a6a8274fd4ef service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089746 Nov 15 12:43:25.193276 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 284/600] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:43:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:43:25.210005 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-dc4d1561-6f89-4461-a785-71c9538bce9d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:43:25.214994 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-dc4d1561-6f89-4461-a785-71c9538bce9d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:25.230465 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-dc4d1561-6f89-4461-a785-71c9538bce9d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:25.231259 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-dc4d1561-6f89-4461-a785-71c9538bce9d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:25.232576 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-dc4d1561-6f89-4461-a785-71c9538bce9d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:25.233230 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-dc4d1561-6f89-4461-a785-71c9538bce9d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:25.485117 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-dc4d1561-6f89-4461-a785-71c9538bce9d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action" status: 202 len: 0 microversion: 2.20 time: 0.289894 Nov 15 12:43:25.485867 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 285/601] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:43:25 2021] POST /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 15 12:43:25.497289 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-70fffeed-2a3c-4fc2-b2ee-32fe3e376811 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:25.498290 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-70fffeed-2a3c-4fc2-b2ee-32fe3e376811 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:25.511140 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-70fffeed-2a3c-4fc2-b2ee-32fe3e376811 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:25.511711 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-70fffeed-2a3c-4fc2-b2ee-32fe3e376811 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:25.513175 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-70fffeed-2a3c-4fc2-b2ee-32fe3e376811 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:25.513943 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-70fffeed-2a3c-4fc2-b2ee-32fe3e376811 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:25.555973 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-780fdbf7-b4b7-4c16-912d-1bb4fc8025b4 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44c99bd2e434807b12facc77f18a5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aae5c632c8b4d4f94206b1d6745c0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:25.576400 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-780fdbf7-b4b7-4c16-912d-1bb4fc8025b4 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "GET /compute/v2.1/servers/ec023efe-8c28-4d57-a7a1-eb10caa7a723" status: 200 len: 1319 microversion: 2.1 time: 0.461630 Nov 15 12:43:25.577731 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 317/602] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:25 2021] GET /compute/v2.1/servers/ec023efe-8c28-4d57-a7a1-eb10caa7a723 => generated 1319 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:43:25.729273 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-70fffeed-2a3c-4fc2-b2ee-32fe3e376811 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:25.738191 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-70fffeed-2a3c-4fc2-b2ee-32fe3e376811 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:25.743736 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-70fffeed-2a3c-4fc2-b2ee-32fe3e376811 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:25.747032 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-70fffeed-2a3c-4fc2-b2ee-32fe3e376811 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1752 microversion: 2.20 time: 0.255169 Nov 15 12:43:25.747872 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 286/603] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:25 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1752 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:26.594238 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-afc4cac3-1701-4799-bc38-2ecb1bf08f33 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:26.596643 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-afc4cac3-1701-4799-bc38-2ecb1bf08f33 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: ec023efe-8c28-4d57-a7a1-eb10caa7a723] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:26.606320 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-afc4cac3-1701-4799-bc38-2ecb1bf08f33 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:26.607124 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-afc4cac3-1701-4799-bc38-2ecb1bf08f33 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:26.608291 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-afc4cac3-1701-4799-bc38-2ecb1bf08f33 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:26.608734 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-afc4cac3-1701-4799-bc38-2ecb1bf08f33 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:26.770887 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-3e497ef2-1f1c-4042-9700-32c20d920b9e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:26.771559 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-3e497ef2-1f1c-4042-9700-32c20d920b9e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:26.781795 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3e497ef2-1f1c-4042-9700-32c20d920b9e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:26.782537 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3e497ef2-1f1c-4042-9700-32c20d920b9e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:26.784103 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3e497ef2-1f1c-4042-9700-32c20d920b9e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:26.784871 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3e497ef2-1f1c-4042-9700-32c20d920b9e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:26.853338 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-afc4cac3-1701-4799-bc38-2ecb1bf08f33 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44c99bd2e434807b12facc77f18a5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aae5c632c8b4d4f94206b1d6745c0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:26.862677 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-afc4cac3-1701-4799-bc38-2ecb1bf08f33 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "GET /compute/v2.1/servers/ec023efe-8c28-4d57-a7a1-eb10caa7a723" status: 200 len: 1319 microversion: 2.1 time: 0.272164 Nov 15 12:43:26.872536 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 318/604] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:26 2021] GET /compute/v2.1/servers/ec023efe-8c28-4d57-a7a1-eb10caa7a723 => generated 1319 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:26.966706 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-3e497ef2-1f1c-4042-9700-32c20d920b9e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:26.982838 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-3e497ef2-1f1c-4042-9700-32c20d920b9e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:26.985077 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-3e497ef2-1f1c-4042-9700-32c20d920b9e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:26.986456 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-3e497ef2-1f1c-4042-9700-32c20d920b9e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1754 microversion: 2.20 time: 0.219265 Nov 15 12:43:26.998560 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 287/605] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:26 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1754 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:27.215374 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [req-4c6b4c93-eb53-489e-a70b-efc454d37271 req-deb20017-93fa-4b06-909c-63803e1e1003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11daa0bc-1e25-47d7-a6df-ffc808e1ff58", "name": "network-vif-unplugged", "status": "completed", "tag": "7a90a770-a011-4cb6-9fcf-893773b8d120"}]} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:43:27.217220 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:43:27.217220 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: warnings.warn(msg) Nov 15 12:43:27.226139 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-4c6b4c93-eb53-489e-a70b-efc454d37271 req-deb20017-93fa-4b06-909c-63803e1e1003 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:27.226566 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-4c6b4c93-eb53-489e-a70b-efc454d37271 req-deb20017-93fa-4b06-909c-63803e1e1003 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:27.243211 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.compute.server_external_events [req-4c6b4c93-eb53-489e-a70b-efc454d37271 req-deb20017-93fa-4b06-909c-63803e1e1003 service nova] Unable to find a host for instance 11daa0bc-1e25-47d7-a6df-ffc808e1ff58. Dropping event network-vif-unplugged {{(pid=122567) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 15 12:43:27.244888 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [req-4c6b4c93-eb53-489e-a70b-efc454d37271 req-deb20017-93fa-4b06-909c-63803e1e1003 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037225 Nov 15 12:43:27.245973 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 319/606] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:43:27 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 15 12:43:27.879939 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-4c8ee0aa-13ff-4f3f-84e4-1554db761dc4 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:27.881163 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-4c8ee0aa-13ff-4f3f-84e4-1554db761dc4 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: ec023efe-8c28-4d57-a7a1-eb10caa7a723] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:27.887532 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4c8ee0aa-13ff-4f3f-84e4-1554db761dc4 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:27.887973 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4c8ee0aa-13ff-4f3f-84e4-1554db761dc4 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:27.888750 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4c8ee0aa-13ff-4f3f-84e4-1554db761dc4 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:27.889178 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4c8ee0aa-13ff-4f3f-84e4-1554db761dc4 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:27.931359 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-ed59da9b-4809-4700-b401-44f4f4ed384a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:27.932767 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-ed59da9b-4809-4700-b401-44f4f4ed384a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:27.939469 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ed59da9b-4809-4700-b401-44f4f4ed384a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:27.940074 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ed59da9b-4809-4700-b401-44f4f4ed384a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:27.940971 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ed59da9b-4809-4700-b401-44f4f4ed384a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:27.941503 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ed59da9b-4809-4700-b401-44f4f4ed384a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:28.034079 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.objects.instance [None req-ed59da9b-4809-4700-b401-44f4f4ed384a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lazy-loading 'services' on Instance uuid a107064a-524f-4964-97da-84d2b50d422d {{(pid=122567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 15 12:43:28.042586 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-4c8ee0aa-13ff-4f3f-84e4-1554db761dc4 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44c99bd2e434807b12facc77f18a5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aae5c632c8b4d4f94206b1d6745c0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:28.052100 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-4c8ee0aa-13ff-4f3f-84e4-1554db761dc4 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "GET /compute/v2.1/servers/ec023efe-8c28-4d57-a7a1-eb10caa7a723" status: 200 len: 1508 microversion: 2.1 time: 0.175895 Nov 15 12:43:28.053078 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 288/607] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:27 2021] GET /compute/v2.1/servers/ec023efe-8c28-4d57-a7a1-eb10caa7a723 => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:28.060358 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-a06e12a9-6527-4a1a-948a-ba19847f15bb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:28.061101 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-a06e12a9-6527-4a1a-948a-ba19847f15bb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:28.068489 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a06e12a9-6527-4a1a-948a-ba19847f15bb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:28.069195 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a06e12a9-6527-4a1a-948a-ba19847f15bb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:28.070571 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a06e12a9-6527-4a1a-948a-ba19847f15bb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:28.071051 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a06e12a9-6527-4a1a-948a-ba19847f15bb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:28.110891 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-ed59da9b-4809-4700-b401-44f4f4ed384a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/os-volume_attachments/00fa0349-ce92-452d-bb24-21ae4ced5d0d" status: 202 len: 0 microversion: 2.1 time: 0.182628 Nov 15 12:43:28.111501 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 320/608] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Nov 15 12:43:27 2021] DELETE /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/os-volume_attachments/00fa0349-ce92-452d-bb24-21ae4ced5d0d => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:43:28.118521 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-31bea091-512b-4dca-bb95-b0f2e590fa8f tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "827cd906-24d4-4b6f-acc1-0754a05d0d98", "device": "/dev/sdb"}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:43:28.123838 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-31bea091-512b-4dca-bb95-b0f2e590fa8f tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: ec023efe-8c28-4d57-a7a1-eb10caa7a723] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:28.138436 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-31bea091-512b-4dca-bb95-b0f2e590fa8f tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:28.138959 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-31bea091-512b-4dca-bb95-b0f2e590fa8f tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:28.139783 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-31bea091-512b-4dca-bb95-b0f2e590fa8f tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:28.140209 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-31bea091-512b-4dca-bb95-b0f2e590fa8f tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:28.305354 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-a06e12a9-6527-4a1a-948a-ba19847f15bb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:28.314251 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-a06e12a9-6527-4a1a-948a-ba19847f15bb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:28.315777 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-a06e12a9-6527-4a1a-948a-ba19847f15bb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:28.317116 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-a06e12a9-6527-4a1a-948a-ba19847f15bb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1810 microversion: 2.20 time: 0.262818 Nov 15 12:43:28.317479 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 289/609] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:28 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1810 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:28.445608 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-26cafe37-b719-4507-a809-42253a573ca9 tempest-VolumesGetTestJSON-1150205114 tempest-VolumesGetTestJSON-1150205114-project] Action: 'create', calling method: .version_select at 0x7f131b4898b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-17940291", "metadata": {"Type": "work"}}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:43:28.462439 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-31bea091-512b-4dca-bb95-b0f2e590fa8f tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "POST /compute/v2.1/servers/ec023efe-8c28-4d57-a7a1-eb10caa7a723/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.349049 Nov 15 12:43:28.463224 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 321/610] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Nov 15 12:43:28 2021] POST /compute/v2.1/servers/ec023efe-8c28-4d57-a7a1-eb10caa7a723/os-volume_attachments => generated 194 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:43:28.766316 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-26cafe37-b719-4507-a809-42253a573ca9 tempest-VolumesGetTestJSON-1150205114 tempest-VolumesGetTestJSON-1150205114-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 0.447611 Nov 15 12:43:28.767228 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 290/611] 10.222.0.43 () {60 vars in 1155 bytes} [Mon Nov 15 12:43:28 2021] POST /compute/v2.1/os-volumes => generated 351 bytes in 449 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 15 12:43:28.780346 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-dcd027cf-4087-4b8b-a859-717d547e3e1c tempest-VolumesGetTestJSON-1150205114 tempest-VolumesGetTestJSON-1150205114-project] Calling method '.version_select at 0x7f132035e9d0>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:28.842371 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-dcd027cf-4087-4b8b-a859-717d547e3e1c tempest-VolumesGetTestJSON-1150205114 tempest-VolumesGetTestJSON-1150205114-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/5f1e217f-d557-42ac-9d02-818757d142d9" status: 200 len: 351 microversion: 2.1 time: 0.067950 Nov 15 12:43:28.842992 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 322/612] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Nov 15 12:43:28 2021] GET /compute/v2.1/os-volumes/5f1e217f-d557-42ac-9d02-818757d142d9 => generated 351 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:43:29.337551 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-d2ffabe0-6b49-4902-824e-f12e688bea84 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:29.338275 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-d2ffabe0-6b49-4902-824e-f12e688bea84 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:29.352461 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d2ffabe0-6b49-4902-824e-f12e688bea84 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:29.352979 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d2ffabe0-6b49-4902-824e-f12e688bea84 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:29.353832 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d2ffabe0-6b49-4902-824e-f12e688bea84 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:29.354895 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d2ffabe0-6b49-4902-824e-f12e688bea84 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:29.512150 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-d2ffabe0-6b49-4902-824e-f12e688bea84 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:29.521860 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-d2ffabe0-6b49-4902-824e-f12e688bea84 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:29.523445 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-d2ffabe0-6b49-4902-824e-f12e688bea84 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:29.524645 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-d2ffabe0-6b49-4902-824e-f12e688bea84 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1810 microversion: 2.20 time: 0.192092 Nov 15 12:43:29.525209 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 291/613] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:29 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1810 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:29.855925 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-d222a5c1-efb2-4d7e-925d-4397097af158 tempest-VolumesGetTestJSON-1150205114 tempest-VolumesGetTestJSON-1150205114-project] Calling method '.version_select at 0x7f1320374820>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:29.905348 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-d222a5c1-efb2-4d7e-925d-4397097af158 tempest-VolumesGetTestJSON-1150205114 tempest-VolumesGetTestJSON-1150205114-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/5f1e217f-d557-42ac-9d02-818757d142d9" status: 200 len: 352 microversion: 2.1 time: 0.054051 Nov 15 12:43:29.905975 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 323/614] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Nov 15 12:43:29 2021] GET /compute/v2.1/os-volumes/5f1e217f-d557-42ac-9d02-818757d142d9 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:43:29.919775 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-8959ef4c-b329-4d8d-be37-238d75666df6 tempest-VolumesGetTestJSON-1150205114 tempest-VolumesGetTestJSON-1150205114-project] Calling method '.version_select at 0x7f131b4b50d0>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:29.975489 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-8959ef4c-b329-4d8d-be37-238d75666df6 tempest-VolumesGetTestJSON-1150205114 tempest-VolumesGetTestJSON-1150205114-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/5f1e217f-d557-42ac-9d02-818757d142d9" status: 200 len: 352 microversion: 2.1 time: 0.061390 Nov 15 12:43:29.976082 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 292/615] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Nov 15 12:43:29 2021] GET /compute/v2.1/os-volumes/5f1e217f-d557-42ac-9d02-818757d142d9 => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:43:29.993702 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-31cb464d-077f-4c0e-a2a5-d8cc9963f92a tempest-VolumesGetTestJSON-1150205114 tempest-VolumesGetTestJSON-1150205114-project] Calling method '.version_select at 0x7f132038adc0>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:30.067921 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-31cb464d-077f-4c0e-a2a5-d8cc9963f92a tempest-VolumesGetTestJSON-1150205114 tempest-VolumesGetTestJSON-1150205114-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/5f1e217f-d557-42ac-9d02-818757d142d9" status: 202 len: 0 microversion: 2.1 time: 0.078408 Nov 15 12:43:30.068588 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 324/616] 10.222.0.43 () {58 vars in 1247 bytes} [Mon Nov 15 12:43:29 2021] DELETE /compute/v2.1/os-volumes/5f1e217f-d557-42ac-9d02-818757d142d9 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:43:30.076364 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-96de4f91-89cb-443f-936c-70c3369e1331 tempest-VolumesGetTestJSON-1150205114 tempest-VolumesGetTestJSON-1150205114-project] Calling method '.version_select at 0x7f131b4cd550>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:30.127402 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-96de4f91-89cb-443f-936c-70c3369e1331 tempest-VolumesGetTestJSON-1150205114 tempest-VolumesGetTestJSON-1150205114-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/5f1e217f-d557-42ac-9d02-818757d142d9" status: 200 len: 351 microversion: 2.1 time: 0.054533 Nov 15 12:43:30.127973 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 293/617] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Nov 15 12:43:30 2021] GET /compute/v2.1/os-volumes/5f1e217f-d557-42ac-9d02-818757d142d9 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 15 12:43:30.351981 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-d9ec9982-4e41-41ac-a8de-a7a3f7c8b5e8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:43:30.362302 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d9ec9982-4e41-41ac-a8de-a7a3f7c8b5e8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:30.363407 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d9ec9982-4e41-41ac-a8de-a7a3f7c8b5e8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:30.434923 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-d9ec9982-4e41-41ac-a8de-a7a3f7c8b5e8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Going to try to stop instance {{(pid=122567) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 15 12:43:30.481737 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-d9ec9982-4e41-41ac-a8de-a7a3f7c8b5e8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 202 len: 0 microversion: 2.1 time: 0.134053 Nov 15 12:43:30.482548 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 325/618] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:43:30 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:43:30.490393 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-35bc12d8-8cac-49db-b983-15b841dabed5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:30.491038 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-35bc12d8-8cac-49db-b983-15b841dabed5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:30.498954 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-35bc12d8-8cac-49db-b983-15b841dabed5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:30.499694 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-35bc12d8-8cac-49db-b983-15b841dabed5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:30.501085 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-35bc12d8-8cac-49db-b983-15b841dabed5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:30.501685 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-35bc12d8-8cac-49db-b983-15b841dabed5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:30.545231 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-99d7f7c8-6248-4d68-aa02-b0046186f3c9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:30.546035 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-99d7f7c8-6248-4d68-aa02-b0046186f3c9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:30.552785 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-99d7f7c8-6248-4d68-aa02-b0046186f3c9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:30.553324 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-99d7f7c8-6248-4d68-aa02-b0046186f3c9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:30.554146 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-99d7f7c8-6248-4d68-aa02-b0046186f3c9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:30.554586 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-99d7f7c8-6248-4d68-aa02-b0046186f3c9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:30.695952 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-35bc12d8-8cac-49db-b983-15b841dabed5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:30.705769 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-35bc12d8-8cac-49db-b983-15b841dabed5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1677 microversion: 2.1 time: 0.218961 Nov 15 12:43:30.706972 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 294/619] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:30 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1677 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:30.754918 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-99d7f7c8-6248-4d68-aa02-b0046186f3c9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:30.764004 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-99d7f7c8-6248-4d68-aa02-b0046186f3c9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:30.765528 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-99d7f7c8-6248-4d68-aa02-b0046186f3c9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:30.766695 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-99d7f7c8-6248-4d68-aa02-b0046186f3c9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1810 microversion: 2.20 time: 0.226742 Nov 15 12:43:30.767298 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 326/620] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:30 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1810 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 15 12:43:31.140495 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-1f49c766-b7ec-4773-ad92-a38727642021 tempest-VolumesGetTestJSON-1150205114 tempest-VolumesGetTestJSON-1150205114-project] Calling method '.version_select at 0x7f131b5f85e0>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:31.169213 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.wsgi [None req-1f49c766-b7ec-4773-ad92-a38727642021 tempest-VolumesGetTestJSON-1150205114 tempest-VolumesGetTestJSON-1150205114-project] HTTP exception thrown: Volume 5f1e217f-d557-42ac-9d02-818757d142d9 could not be found. Nov 15 12:43:31.169921 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-1f49c766-b7ec-4773-ad92-a38727642021 tempest-VolumesGetTestJSON-1150205114 tempest-VolumesGetTestJSON-1150205114-project] Returning 404 to user: Volume 5f1e217f-d557-42ac-9d02-818757d142d9 could not be found. {{(pid=122568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:43:31.170887 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-1f49c766-b7ec-4773-ad92-a38727642021 tempest-VolumesGetTestJSON-1150205114 tempest-VolumesGetTestJSON-1150205114-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/5f1e217f-d557-42ac-9d02-818757d142d9" status: 404 len: 109 microversion: 2.1 time: 0.034199 Nov 15 12:43:31.171473 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 295/621] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Nov 15 12:43:31 2021] GET /compute/v2.1/os-volumes/5f1e217f-d557-42ac-9d02-818757d142d9 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 15 12:43:31.728140 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-f95bd0be-ab5e-4b68-bb4b-6ec5992a0735 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:31.729150 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-f95bd0be-ab5e-4b68-bb4b-6ec5992a0735 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:31.737625 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f95bd0be-ab5e-4b68-bb4b-6ec5992a0735 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:31.738066 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f95bd0be-ab5e-4b68-bb4b-6ec5992a0735 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:31.738885 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f95bd0be-ab5e-4b68-bb4b-6ec5992a0735 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:31.739313 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f95bd0be-ab5e-4b68-bb4b-6ec5992a0735 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:31.790447 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-d1ec2bd8-8a01-4940-85da-b6146fe1015a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:31.793524 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-d1ec2bd8-8a01-4940-85da-b6146fe1015a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:31.801767 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d1ec2bd8-8a01-4940-85da-b6146fe1015a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:31.802475 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d1ec2bd8-8a01-4940-85da-b6146fe1015a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:31.803462 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d1ec2bd8-8a01-4940-85da-b6146fe1015a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:31.804045 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d1ec2bd8-8a01-4940-85da-b6146fe1015a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:32.003594 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-f95bd0be-ab5e-4b68-bb4b-6ec5992a0735 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:32.013532 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-f95bd0be-ab5e-4b68-bb4b-6ec5992a0735 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1677 microversion: 2.1 time: 0.293555 Nov 15 12:43:32.014128 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 327/622] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:31 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1677 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:32.044123 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-d1ec2bd8-8a01-4940-85da-b6146fe1015a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:32.059613 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-d1ec2bd8-8a01-4940-85da-b6146fe1015a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:32.061850 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-d1ec2bd8-8a01-4940-85da-b6146fe1015a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:32.063467 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-d1ec2bd8-8a01-4940-85da-b6146fe1015a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1810 microversion: 2.20 time: 0.281749 Nov 15 12:43:32.076490 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 296/623] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:31 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1810 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 15 12:43:33.031354 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-f91001f4-c7a4-4fd1-b261-7213222c4677 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:33.031973 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-f91001f4-c7a4-4fd1-b261-7213222c4677 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:33.038960 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f91001f4-c7a4-4fd1-b261-7213222c4677 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:33.039406 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f91001f4-c7a4-4fd1-b261-7213222c4677 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:33.040193 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f91001f4-c7a4-4fd1-b261-7213222c4677 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:33.040751 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f91001f4-c7a4-4fd1-b261-7213222c4677 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:33.088333 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-6ea7cd3d-757d-404d-b9cd-2f75e3c88edc tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:33.089568 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-6ea7cd3d-757d-404d-b9cd-2f75e3c88edc tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:33.097580 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6ea7cd3d-757d-404d-b9cd-2f75e3c88edc tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:33.098322 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6ea7cd3d-757d-404d-b9cd-2f75e3c88edc tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:33.099387 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6ea7cd3d-757d-404d-b9cd-2f75e3c88edc tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:33.099983 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6ea7cd3d-757d-404d-b9cd-2f75e3c88edc tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:33.312696 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-f91001f4-c7a4-4fd1-b261-7213222c4677 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:33.316698 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-6ea7cd3d-757d-404d-b9cd-2f75e3c88edc tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:33.328680 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-6ea7cd3d-757d-404d-b9cd-2f75e3c88edc tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:33.330022 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-f91001f4-c7a4-4fd1-b261-7213222c4677 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1677 microversion: 2.1 time: 0.302154 Nov 15 12:43:33.330970 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 328/624] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:33 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1677 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:33.331477 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-6ea7cd3d-757d-404d-b9cd-2f75e3c88edc tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:33.332948 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-6ea7cd3d-757d-404d-b9cd-2f75e3c88edc tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1810 microversion: 2.20 time: 0.248487 Nov 15 12:43:33.333581 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 297/625] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:33 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1810 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 15 12:43:34.349119 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-0c2daf24-d8f8-4a3c-aac9-6d084afbb024 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:34.349930 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-0c2daf24-d8f8-4a3c-aac9-6d084afbb024 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:34.352839 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-0067b50e-ed88-4704-aaf4-aef344481b9c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:34.353323 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-0067b50e-ed88-4704-aaf4-aef344481b9c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:34.357833 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0c2daf24-d8f8-4a3c-aac9-6d084afbb024 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:34.358489 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0c2daf24-d8f8-4a3c-aac9-6d084afbb024 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:34.359496 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0c2daf24-d8f8-4a3c-aac9-6d084afbb024 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:34.360042 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0c2daf24-d8f8-4a3c-aac9-6d084afbb024 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:34.361462 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0067b50e-ed88-4704-aaf4-aef344481b9c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:34.362111 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0067b50e-ed88-4704-aaf4-aef344481b9c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:34.363107 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0067b50e-ed88-4704-aaf4-aef344481b9c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:34.363696 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0067b50e-ed88-4704-aaf4-aef344481b9c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:34.599018 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-0c2daf24-d8f8-4a3c-aac9-6d084afbb024 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:34.609594 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-0c2daf24-d8f8-4a3c-aac9-6d084afbb024 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1677 microversion: 2.1 time: 0.265600 Nov 15 12:43:34.610192 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 329/626] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:34 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1677 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:34.627799 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-0067b50e-ed88-4704-aaf4-aef344481b9c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:34.637645 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-0067b50e-ed88-4704-aaf4-aef344481b9c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:34.639565 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-0067b50e-ed88-4704-aaf4-aef344481b9c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:34.640993 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-0067b50e-ed88-4704-aaf4-aef344481b9c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1810 microversion: 2.20 time: 0.292541 Nov 15 12:43:34.641783 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 298/627] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:34 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1810 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 15 12:43:35.627321 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-42971c20-2c87-4058-b737-a09637a9b050 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:35.628086 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-42971c20-2c87-4058-b737-a09637a9b050 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:35.634368 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-42971c20-2c87-4058-b737-a09637a9b050 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:35.635660 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-42971c20-2c87-4058-b737-a09637a9b050 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:35.636288 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-42971c20-2c87-4058-b737-a09637a9b050 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:35.636725 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-42971c20-2c87-4058-b737-a09637a9b050 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:35.660899 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-42898f4f-7df8-459d-bfce-9b1f89b0aa89 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:35.662200 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-42898f4f-7df8-459d-bfce-9b1f89b0aa89 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:35.669323 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-42898f4f-7df8-459d-bfce-9b1f89b0aa89 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:35.670041 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-42898f4f-7df8-459d-bfce-9b1f89b0aa89 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:35.671031 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-42898f4f-7df8-459d-bfce-9b1f89b0aa89 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:35.671670 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-42898f4f-7df8-459d-bfce-9b1f89b0aa89 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:35.914143 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-42971c20-2c87-4058-b737-a09637a9b050 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:35.923330 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-42971c20-2c87-4058-b737-a09637a9b050 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1677 microversion: 2.1 time: 0.299691 Nov 15 12:43:35.931399 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 330/628] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:35 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1677 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:35.932056 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-42898f4f-7df8-459d-bfce-9b1f89b0aa89 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:35.941619 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-42898f4f-7df8-459d-bfce-9b1f89b0aa89 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:35.943564 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-42898f4f-7df8-459d-bfce-9b1f89b0aa89 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:35.944807 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-42898f4f-7df8-459d-bfce-9b1f89b0aa89 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1810 microversion: 2.20 time: 0.287686 Nov 15 12:43:35.946016 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 299/629] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:35 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1810 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 15 12:43:36.941614 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-360cd3a1-3f7a-4bf2-a406-4f8efecc87c8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:36.942317 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-360cd3a1-3f7a-4bf2-a406-4f8efecc87c8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:36.949013 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-360cd3a1-3f7a-4bf2-a406-4f8efecc87c8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:36.949478 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-360cd3a1-3f7a-4bf2-a406-4f8efecc87c8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:36.950490 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-360cd3a1-3f7a-4bf2-a406-4f8efecc87c8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:36.950958 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-360cd3a1-3f7a-4bf2-a406-4f8efecc87c8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:36.964944 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-10177679-7845-4210-b044-06825be16065 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:36.965550 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-10177679-7845-4210-b044-06825be16065 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:36.975615 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-10177679-7845-4210-b044-06825be16065 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:36.976055 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-10177679-7845-4210-b044-06825be16065 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:36.977132 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-10177679-7845-4210-b044-06825be16065 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:36.977587 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-10177679-7845-4210-b044-06825be16065 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:37.203884 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-10177679-7845-4210-b044-06825be16065 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:37.204139 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-360cd3a1-3f7a-4bf2-a406-4f8efecc87c8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:37.214742 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-10177679-7845-4210-b044-06825be16065 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:37.215263 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-360cd3a1-3f7a-4bf2-a406-4f8efecc87c8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1677 microversion: 2.1 time: 0.277222 Nov 15 12:43:37.215858 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 331/630] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:36 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1677 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:37.216677 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-10177679-7845-4210-b044-06825be16065 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:37.217930 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-10177679-7845-4210-b044-06825be16065 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1810 microversion: 2.20 time: 0.257539 Nov 15 12:43:37.218580 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 300/631] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:36 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1810 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 15 12:43:38.240622 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-46d4fff5-5664-4f77-bd5b-897e16547a76 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:38.242133 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-46d4fff5-5664-4f77-bd5b-897e16547a76 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:38.245535 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e1b4f5eb-4f7e-4fab-bbc1-5f565e779970 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:38.246916 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e1b4f5eb-4f7e-4fab-bbc1-5f565e779970 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:38.258121 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-46d4fff5-5664-4f77-bd5b-897e16547a76 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:38.261350 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e1b4f5eb-4f7e-4fab-bbc1-5f565e779970 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:38.262178 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-46d4fff5-5664-4f77-bd5b-897e16547a76 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:38.263214 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-46d4fff5-5664-4f77-bd5b-897e16547a76 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:38.264007 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-46d4fff5-5664-4f77-bd5b-897e16547a76 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:38.265822 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e1b4f5eb-4f7e-4fab-bbc1-5f565e779970 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:38.269870 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e1b4f5eb-4f7e-4fab-bbc1-5f565e779970 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:38.270549 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e1b4f5eb-4f7e-4fab-bbc1-5f565e779970 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:38.495260 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e1b4f5eb-4f7e-4fab-bbc1-5f565e779970 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:38.498432 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-46d4fff5-5664-4f77-bd5b-897e16547a76 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:38.502983 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e1b4f5eb-4f7e-4fab-bbc1-5f565e779970 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1677 microversion: 2.1 time: 0.273273 Nov 15 12:43:38.503563 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 332/632] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:38 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1677 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:38.506753 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-46d4fff5-5664-4f77-bd5b-897e16547a76 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:38.508272 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-46d4fff5-5664-4f77-bd5b-897e16547a76 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:38.509417 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-46d4fff5-5664-4f77-bd5b-897e16547a76 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1810 microversion: 2.20 time: 0.276961 Nov 15 12:43:38.510485 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 301/633] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:38 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1810 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:39.521077 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-b429bf56-96b2-451a-9f18-ebba1a0e22a1 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:39.522397 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-b429bf56-96b2-451a-9f18-ebba1a0e22a1 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:39.528001 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-4a06e2b9-d493-47b7-972f-6255f14bc3c6 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:39.529205 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b429bf56-96b2-451a-9f18-ebba1a0e22a1 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:39.529653 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-4a06e2b9-d493-47b7-972f-6255f14bc3c6 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:39.529773 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b429bf56-96b2-451a-9f18-ebba1a0e22a1 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:39.530578 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b429bf56-96b2-451a-9f18-ebba1a0e22a1 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:39.531127 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b429bf56-96b2-451a-9f18-ebba1a0e22a1 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:39.540083 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4a06e2b9-d493-47b7-972f-6255f14bc3c6 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:39.541805 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4a06e2b9-d493-47b7-972f-6255f14bc3c6 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:39.542812 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4a06e2b9-d493-47b7-972f-6255f14bc3c6 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:39.543400 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4a06e2b9-d493-47b7-972f-6255f14bc3c6 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:39.766942 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-b429bf56-96b2-451a-9f18-ebba1a0e22a1 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:39.771286 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-4a06e2b9-d493-47b7-972f-6255f14bc3c6 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:39.777044 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-b429bf56-96b2-451a-9f18-ebba1a0e22a1 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1677 microversion: 2.1 time: 0.258425 Nov 15 12:43:39.777736 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 333/634] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:39 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1677 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:39.782895 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-4a06e2b9-d493-47b7-972f-6255f14bc3c6 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:39.784635 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-4a06e2b9-d493-47b7-972f-6255f14bc3c6 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:39.785985 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-4a06e2b9-d493-47b7-972f-6255f14bc3c6 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1810 microversion: 2.20 time: 0.262029 Nov 15 12:43:39.786561 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 302/635] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:39 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1810 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:40.795612 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-6bbaa0f2-7cb0-4390-ba67-2dc29f5aab72 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:40.796215 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-6bbaa0f2-7cb0-4390-ba67-2dc29f5aab72 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:40.802319 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6bbaa0f2-7cb0-4390-ba67-2dc29f5aab72 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:40.802788 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6bbaa0f2-7cb0-4390-ba67-2dc29f5aab72 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:40.803812 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6bbaa0f2-7cb0-4390-ba67-2dc29f5aab72 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:40.803987 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6bbaa0f2-7cb0-4390-ba67-2dc29f5aab72 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:40.805145 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-bd49a6bf-d6e2-44f8-8f85-67bc253f9b2d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:40.805908 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-bd49a6bf-d6e2-44f8-8f85-67bc253f9b2d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:40.813056 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bd49a6bf-d6e2-44f8-8f85-67bc253f9b2d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:40.813501 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bd49a6bf-d6e2-44f8-8f85-67bc253f9b2d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:40.814308 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bd49a6bf-d6e2-44f8-8f85-67bc253f9b2d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:40.814935 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bd49a6bf-d6e2-44f8-8f85-67bc253f9b2d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:41.023769 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-bd49a6bf-d6e2-44f8-8f85-67bc253f9b2d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:41.028439 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-6bbaa0f2-7cb0-4390-ba67-2dc29f5aab72 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:41.033584 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-bd49a6bf-d6e2-44f8-8f85-67bc253f9b2d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:41.035104 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-bd49a6bf-d6e2-44f8-8f85-67bc253f9b2d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:41.036288 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-bd49a6bf-d6e2-44f8-8f85-67bc253f9b2d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1810 microversion: 2.20 time: 0.235059 Nov 15 12:43:41.036842 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 303/636] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:40 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1810 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:41.037548 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-6bbaa0f2-7cb0-4390-ba67-2dc29f5aab72 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1677 microversion: 2.1 time: 0.245741 Nov 15 12:43:41.038130 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 334/637] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:40 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1677 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:42.056231 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-5a6055a9-55a0-4f59-ae8b-58105d9d8f8a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:42.057181 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-5a6055a9-55a0-4f59-ae8b-58105d9d8f8a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:42.063471 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-9af740d9-ad1b-44a8-a8d1-3b8683b49226 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:42.063910 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-9af740d9-ad1b-44a8-a8d1-3b8683b49226 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:42.073720 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9af740d9-ad1b-44a8-a8d1-3b8683b49226 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:42.074186 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9af740d9-ad1b-44a8-a8d1-3b8683b49226 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:42.074993 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9af740d9-ad1b-44a8-a8d1-3b8683b49226 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:42.075427 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9af740d9-ad1b-44a8-a8d1-3b8683b49226 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:42.080784 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5a6055a9-55a0-4f59-ae8b-58105d9d8f8a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:42.081225 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5a6055a9-55a0-4f59-ae8b-58105d9d8f8a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:42.082204 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5a6055a9-55a0-4f59-ae8b-58105d9d8f8a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:42.082817 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5a6055a9-55a0-4f59-ae8b-58105d9d8f8a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:42.318757 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-5a6055a9-55a0-4f59-ae8b-58105d9d8f8a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:42.327036 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-9af740d9-ad1b-44a8-a8d1-3b8683b49226 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:42.328899 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-5a6055a9-55a0-4f59-ae8b-58105d9d8f8a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1677 microversion: 2.1 time: 0.276221 Nov 15 12:43:42.330140 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 304/638] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:42 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1677 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:42.338925 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-9af740d9-ad1b-44a8-a8d1-3b8683b49226 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:42.340561 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-9af740d9-ad1b-44a8-a8d1-3b8683b49226 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:42.342957 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-9af740d9-ad1b-44a8-a8d1-3b8683b49226 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1810 microversion: 2.20 time: 0.282749 Nov 15 12:43:42.342957 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 335/639] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:42 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1810 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:43.347024 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-5e8927a6-2423-44b3-8f70-f257638cdadb tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:43.347783 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-5e8927a6-2423-44b3-8f70-f257638cdadb tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:43.354901 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5e8927a6-2423-44b3-8f70-f257638cdadb tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:43.360325 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-7654b72e-3c59-4641-91c5-c9c00c9d21f5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:43.361084 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-7654b72e-3c59-4641-91c5-c9c00c9d21f5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:43.365694 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5e8927a6-2423-44b3-8f70-f257638cdadb tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:43.366698 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5e8927a6-2423-44b3-8f70-f257638cdadb tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:43.367159 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5e8927a6-2423-44b3-8f70-f257638cdadb tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:43.372646 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7654b72e-3c59-4641-91c5-c9c00c9d21f5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:43.373087 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7654b72e-3c59-4641-91c5-c9c00c9d21f5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:43.373878 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7654b72e-3c59-4641-91c5-c9c00c9d21f5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:43.374305 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7654b72e-3c59-4641-91c5-c9c00c9d21f5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:43.612125 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-7654b72e-3c59-4641-91c5-c9c00c9d21f5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:43.621391 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-5e8927a6-2423-44b3-8f70-f257638cdadb tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:43.621893 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-7654b72e-3c59-4641-91c5-c9c00c9d21f5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:43.623678 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-7654b72e-3c59-4641-91c5-c9c00c9d21f5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:43.624943 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-7654b72e-3c59-4641-91c5-c9c00c9d21f5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1810 microversion: 2.20 time: 0.268410 Nov 15 12:43:43.625514 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 336/640] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:43 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1810 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:43.630330 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-5e8927a6-2423-44b3-8f70-f257638cdadb tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1677 microversion: 2.1 time: 0.287059 Nov 15 12:43:43.632006 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 305/641] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:43 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1677 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:44.645832 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-43e91884-0435-4ffd-b77c-28e78bee5d69 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:44.647124 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-43e91884-0435-4ffd-b77c-28e78bee5d69 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:44.647718 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-0f27d8e0-e52a-4faa-bffd-79341a10b19d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:44.648798 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-0f27d8e0-e52a-4faa-bffd-79341a10b19d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:44.655623 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0f27d8e0-e52a-4faa-bffd-79341a10b19d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:44.656025 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-43e91884-0435-4ffd-b77c-28e78bee5d69 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:44.656177 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0f27d8e0-e52a-4faa-bffd-79341a10b19d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:44.656481 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-43e91884-0435-4ffd-b77c-28e78bee5d69 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:44.656825 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0f27d8e0-e52a-4faa-bffd-79341a10b19d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:44.657254 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0f27d8e0-e52a-4faa-bffd-79341a10b19d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:44.657421 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-43e91884-0435-4ffd-b77c-28e78bee5d69 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:44.657851 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-43e91884-0435-4ffd-b77c-28e78bee5d69 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:44.870738 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-43e91884-0435-4ffd-b77c-28e78bee5d69 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:44.880490 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-43e91884-0435-4ffd-b77c-28e78bee5d69 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:44.882084 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-43e91884-0435-4ffd-b77c-28e78bee5d69 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:44.882462 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-0f27d8e0-e52a-4faa-bffd-79341a10b19d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:44.883575 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-43e91884-0435-4ffd-b77c-28e78bee5d69 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1810 microversion: 2.20 time: 0.243133 Nov 15 12:43:44.884317 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 337/642] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:44 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1810 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:44.890582 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-0f27d8e0-e52a-4faa-bffd-79341a10b19d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1677 microversion: 2.1 time: 0.246392 Nov 15 12:43:44.891179 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 306/643] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:44 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1677 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:45.904830 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-edaafc88-e78a-47fa-ae04-73e29628e5b9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:45.905899 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-edaafc88-e78a-47fa-ae04-73e29628e5b9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:45.910235 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-4d70af03-2f5f-4316-aac8-585a2e24add5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:45.911192 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-4d70af03-2f5f-4316-aac8-585a2e24add5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:45.917087 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-edaafc88-e78a-47fa-ae04-73e29628e5b9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:45.917918 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-edaafc88-e78a-47fa-ae04-73e29628e5b9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:45.919398 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-edaafc88-e78a-47fa-ae04-73e29628e5b9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:45.920703 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-edaafc88-e78a-47fa-ae04-73e29628e5b9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:45.921863 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4d70af03-2f5f-4316-aac8-585a2e24add5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:45.922908 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4d70af03-2f5f-4316-aac8-585a2e24add5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:45.924212 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4d70af03-2f5f-4316-aac8-585a2e24add5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:45.924923 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4d70af03-2f5f-4316-aac8-585a2e24add5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:46.118562 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-4d70af03-2f5f-4316-aac8-585a2e24add5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:46.122396 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-edaafc88-e78a-47fa-ae04-73e29628e5b9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:46.126430 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-4d70af03-2f5f-4316-aac8-585a2e24add5 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1677 microversion: 2.1 time: 0.222508 Nov 15 12:43:46.127179 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 307/644] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:45 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1677 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:46.130727 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-edaafc88-e78a-47fa-ae04-73e29628e5b9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:46.132451 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-edaafc88-e78a-47fa-ae04-73e29628e5b9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:46.133600 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-edaafc88-e78a-47fa-ae04-73e29628e5b9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1810 microversion: 2.20 time: 0.234310 Nov 15 12:43:46.134144 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 338/645] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:45 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1810 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:47.144847 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-b5bb5ff5-9b8e-4f9a-9965-8a81a08199c0 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:47.145640 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-b5bb5ff5-9b8e-4f9a-9965-8a81a08199c0 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:47.152927 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-0e277dc0-6d02-448d-ac8a-f5b4bed99eb4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:47.154440 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-0e277dc0-6d02-448d-ac8a-f5b4bed99eb4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:47.155907 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b5bb5ff5-9b8e-4f9a-9965-8a81a08199c0 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:47.156467 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b5bb5ff5-9b8e-4f9a-9965-8a81a08199c0 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:47.157158 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b5bb5ff5-9b8e-4f9a-9965-8a81a08199c0 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:47.157591 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b5bb5ff5-9b8e-4f9a-9965-8a81a08199c0 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:47.162553 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0e277dc0-6d02-448d-ac8a-f5b4bed99eb4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:47.163098 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0e277dc0-6d02-448d-ac8a-f5b4bed99eb4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:47.164072 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0e277dc0-6d02-448d-ac8a-f5b4bed99eb4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:47.164575 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0e277dc0-6d02-448d-ac8a-f5b4bed99eb4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:47.378357 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-b5bb5ff5-9b8e-4f9a-9965-8a81a08199c0 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:47.385582 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-0e277dc0-6d02-448d-ac8a-f5b4bed99eb4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:47.387088 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-b5bb5ff5-9b8e-4f9a-9965-8a81a08199c0 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1677 microversion: 2.1 time: 0.246685 Nov 15 12:43:47.387690 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 308/646] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:47 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1677 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:47.394822 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-0e277dc0-6d02-448d-ac8a-f5b4bed99eb4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:47.396400 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-0e277dc0-6d02-448d-ac8a-f5b4bed99eb4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:47.397596 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-0e277dc0-6d02-448d-ac8a-f5b4bed99eb4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1810 microversion: 2.20 time: 0.248925 Nov 15 12:43:47.398239 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 339/647] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:47 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1810 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 15 12:43:48.405797 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-be30301b-df25-41b6-abda-2455d8495dd1 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:48.406615 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-be30301b-df25-41b6-abda-2455d8495dd1 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:48.413693 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-be30301b-df25-41b6-abda-2455d8495dd1 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:48.414195 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-be30301b-df25-41b6-abda-2455d8495dd1 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:48.415150 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-be30301b-df25-41b6-abda-2455d8495dd1 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:48.415652 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-be30301b-df25-41b6-abda-2455d8495dd1 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:48.419024 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-cb263a10-7488-4215-bff7-77f61996e5db tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:48.419521 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-cb263a10-7488-4215-bff7-77f61996e5db tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:48.426421 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cb263a10-7488-4215-bff7-77f61996e5db tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:48.427197 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cb263a10-7488-4215-bff7-77f61996e5db tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:48.427690 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cb263a10-7488-4215-bff7-77f61996e5db tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:48.428119 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cb263a10-7488-4215-bff7-77f61996e5db tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:48.653867 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-be30301b-df25-41b6-abda-2455d8495dd1 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:48.656710 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-cb263a10-7488-4215-bff7-77f61996e5db tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:48.661704 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-be30301b-df25-41b6-abda-2455d8495dd1 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1677 microversion: 2.1 time: 0.259913 Nov 15 12:43:48.662278 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 309/648] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:48 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1677 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:48.669029 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-cb263a10-7488-4215-bff7-77f61996e5db tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:48.669029 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-cb263a10-7488-4215-bff7-77f61996e5db tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:48.669029 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-cb263a10-7488-4215-bff7-77f61996e5db tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1810 microversion: 2.20 time: 0.255782 Nov 15 12:43:48.669364 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 340/649] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:48 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1810 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:49.681538 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-80f421dc-d1ae-450a-a204-b89290d17028 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:49.681538 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-80f421dc-d1ae-450a-a204-b89290d17028 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:49.687452 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-51aeaee7-a435-4fb2-af5b-e4332cdb067c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:49.687937 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-80f421dc-d1ae-450a-a204-b89290d17028 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:49.688084 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-51aeaee7-a435-4fb2-af5b-e4332cdb067c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:49.688698 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-80f421dc-d1ae-450a-a204-b89290d17028 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:49.689480 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-80f421dc-d1ae-450a-a204-b89290d17028 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:49.690078 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-80f421dc-d1ae-450a-a204-b89290d17028 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:49.694595 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-51aeaee7-a435-4fb2-af5b-e4332cdb067c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:49.695450 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-51aeaee7-a435-4fb2-af5b-e4332cdb067c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:49.698204 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-51aeaee7-a435-4fb2-af5b-e4332cdb067c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:49.698645 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-51aeaee7-a435-4fb2-af5b-e4332cdb067c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:49.903416 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-80f421dc-d1ae-450a-a204-b89290d17028 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:49.910655 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-51aeaee7-a435-4fb2-af5b-e4332cdb067c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:49.911088 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-80f421dc-d1ae-450a-a204-b89290d17028 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1677 microversion: 2.1 time: 0.234643 Nov 15 12:43:49.911751 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 310/650] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:49 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1677 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:49.921175 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-51aeaee7-a435-4fb2-af5b-e4332cdb067c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:49.923024 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-51aeaee7-a435-4fb2-af5b-e4332cdb067c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:49.924283 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-51aeaee7-a435-4fb2-af5b-e4332cdb067c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1810 microversion: 2.20 time: 0.240829 Nov 15 12:43:49.924833 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 341/651] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:49 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1810 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:50.929544 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-ee082b30-5111-4b42-a521-4ce69fc9735a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:50.930298 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-ee082b30-5111-4b42-a521-4ce69fc9735a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:50.936768 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ee082b30-5111-4b42-a521-4ce69fc9735a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:50.937213 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ee082b30-5111-4b42-a521-4ce69fc9735a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:50.937989 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ee082b30-5111-4b42-a521-4ce69fc9735a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:50.938420 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ee082b30-5111-4b42-a521-4ce69fc9735a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:50.942602 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-a9ebfe54-9792-478f-bb71-f37ef5f48aea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:50.943921 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-a9ebfe54-9792-478f-bb71-f37ef5f48aea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:50.951624 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a9ebfe54-9792-478f-bb71-f37ef5f48aea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:50.952120 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a9ebfe54-9792-478f-bb71-f37ef5f48aea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:50.952869 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a9ebfe54-9792-478f-bb71-f37ef5f48aea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:50.953315 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a9ebfe54-9792-478f-bb71-f37ef5f48aea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:51.188522 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-ee082b30-5111-4b42-a521-4ce69fc9735a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:51.198893 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-ee082b30-5111-4b42-a521-4ce69fc9735a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1677 microversion: 2.1 time: 0.272869 Nov 15 12:43:51.199481 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 311/652] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:50 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1677 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:51.214011 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-a9ebfe54-9792-478f-bb71-f37ef5f48aea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:51.224382 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-a9ebfe54-9792-478f-bb71-f37ef5f48aea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:51.225793 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-a9ebfe54-9792-478f-bb71-f37ef5f48aea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:51.226983 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-a9ebfe54-9792-478f-bb71-f37ef5f48aea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1810 microversion: 2.20 time: 0.288112 Nov 15 12:43:51.227576 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 342/653] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:50 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1810 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:52.223396 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-4f6395ac-4570-4278-8117-0c45c0645986 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:52.224091 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-4f6395ac-4570-4278-8117-0c45c0645986 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:52.226182 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-77ea2723-a174-4538-896c-889ce28a86c5 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1012846602", "imageRef": "3cc21e2c-27da-4266-be76-369023341c16", "flavorRef": "452", "networks": [{"uuid": "29845f19-cbb4-4be4-8944-6f3102b0a7e4"}]}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:43:52.231318 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4f6395ac-4570-4278-8117-0c45c0645986 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:52.231826 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4f6395ac-4570-4278-8117-0c45c0645986 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:52.232667 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4f6395ac-4570-4278-8117-0c45c0645986 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:52.233181 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4f6395ac-4570-4278-8117-0c45c0645986 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:52.278172 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.network.neutron [None req-77ea2723-a174-4538-896c-889ce28a86c5 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] validate_networks() for [('29845f19-cbb4-4be4-8944-6f3102b0a7e4', None, None, None, None, None)] {{(pid=122567) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 15 12:43:52.466223 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-4f6395ac-4570-4278-8117-0c45c0645986 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:52.473869 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-4f6395ac-4570-4278-8117-0c45c0645986 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1654 microversion: 2.1 time: 0.257979 Nov 15 12:43:52.474446 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 312/654] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:52 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1654 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:52.479231 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-f597a453-9cd9-4357-ac34-183030745949 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:52.480198 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-f597a453-9cd9-4357-ac34-183030745949 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:52.486490 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f597a453-9cd9-4357-ac34-183030745949 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:52.486969 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f597a453-9cd9-4357-ac34-183030745949 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:52.487753 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f597a453-9cd9-4357-ac34-183030745949 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:52.488177 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f597a453-9cd9-4357-ac34-183030745949 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:52.727845 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-f597a453-9cd9-4357-ac34-183030745949 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:52.736690 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-f597a453-9cd9-4357-ac34-183030745949 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:52.738346 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-f597a453-9cd9-4357-ac34-183030745949 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:52.739549 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-f597a453-9cd9-4357-ac34-183030745949 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1810 microversion: 2.20 time: 0.263939 Nov 15 12:43:52.740116 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 313/655] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:52 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1810 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:52.744739 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-27f95d61-eecb-4063-9bfe-b55b85f0a6c6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:43:52.750654 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-27f95d61-eecb-4063-9bfe-b55b85f0a6c6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:52.751137 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-27f95d61-eecb-4063-9bfe-b55b85f0a6c6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:52.769656 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-77ea2723-a174-4538-896c-889ce28a86c5 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Flavor limits 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 15 12:43:52.770076 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-77ea2723-a174-4538-896c-889ce28a86c5 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Image limits 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 15 12:43:52.770548 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-77ea2723-a174-4538-896c-889ce28a86c5 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Flavor pref 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 15 12:43:52.770985 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-77ea2723-a174-4538-896c-889ce28a86c5 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Image pref 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 15 12:43:52.771394 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-77ea2723-a174-4538-896c-889ce28a86c5 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 15 12:43:52.774178 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-27f95d61-eecb-4063-9bfe-b55b85f0a6c6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Going to try to start instance {{(pid=122568) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 15 12:43:52.780948 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-77ea2723-a174-4538-896c-889ce28a86c5 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:52.781392 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-77ea2723-a174-4538-896c-889ce28a86c5 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:52.782191 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-77ea2723-a174-4538-896c-889ce28a86c5 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:52.782621 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-77ea2723-a174-4538-896c-889ce28a86c5 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:52.799784 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.quota [None req-77ea2723-a174-4538-896c-889ce28a86c5 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Getting quotas for project ff96d81628ad4a9a884766ce86b9c684. Resources: {'cores', 'ram', 'instances'} {{(pid=122567) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:43:52.803820 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.quota [None req-77ea2723-a174-4538-896c-889ce28a86c5 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Getting quotas for user 635a7f2e64b64ab0be3a8a9270c0cadb and project ff96d81628ad4a9a884766ce86b9c684. Resources: {'cores', 'ram', 'instances'} {{(pid=122567) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:43:52.816375 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-77ea2723-a174-4538-896c-889ce28a86c5 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Going to run 1 instances... {{(pid=122567) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 15 12:43:52.818665 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-27f95d61-eecb-4063-9bfe-b55b85f0a6c6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action" status: 202 len: 0 microversion: 2.1 time: 0.077307 Nov 15 12:43:52.818962 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-77ea2723-a174-4538-896c-889ce28a86c5 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 11603efa-1f82-404a-9f04-bf3b2efb2905] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3cc21e2c-27da-4266-be76-369023341c16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 15 12:43:52.819326 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 314/656] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:43:52 2021] POST /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:43:52.828604 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-9690dbe7-db53-4fbb-8c3e-9cd7e4db76bb tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:52.829302 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-9690dbe7-db53-4fbb-8c3e-9cd7e4db76bb tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:52.835762 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9690dbe7-db53-4fbb-8c3e-9cd7e4db76bb tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:52.836175 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9690dbe7-db53-4fbb-8c3e-9cd7e4db76bb tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:52.837045 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9690dbe7-db53-4fbb-8c3e-9cd7e4db76bb tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:52.837504 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9690dbe7-db53-4fbb-8c3e-9cd7e4db76bb tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:52.868517 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-77ea2723-a174-4538-896c-889ce28a86c5 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.645793 Nov 15 12:43:52.870258 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 343/657] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Nov 15 12:43:52 2021] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 15 12:43:52.880325 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-d5ed1ef3-7194-49f5-ad1a-d61b38510aa3 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:52.880936 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-d5ed1ef3-7194-49f5-ad1a-d61b38510aa3 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 11603efa-1f82-404a-9f04-bf3b2efb2905] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:52.946038 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-d5ed1ef3-7194-49f5-ad1a-d61b38510aa3 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635a7f2e64b64ab0be3a8a9270c0cadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff96d81628ad4a9a884766ce86b9c684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:52.956639 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-d5ed1ef3-7194-49f5-ad1a-d61b38510aa3 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "GET /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905" status: 200 len: 1214 microversion: 2.1 time: 0.080097 Nov 15 12:43:52.957609 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 344/658] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:52 2021] GET /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:43:53.021038 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-9690dbe7-db53-4fbb-8c3e-9cd7e4db76bb tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:53.029220 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-9690dbe7-db53-4fbb-8c3e-9cd7e4db76bb tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1663 microversion: 2.1 time: 0.204745 Nov 15 12:43:53.029802 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 315/659] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:52 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1663 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:53.757266 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-0e6b7fa5-2803-42ff-ae6a-abc49aa09080 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:53.757845 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-0e6b7fa5-2803-42ff-ae6a-abc49aa09080 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:53.765149 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0e6b7fa5-2803-42ff-ae6a-abc49aa09080 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:53.765589 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0e6b7fa5-2803-42ff-ae6a-abc49aa09080 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:53.766397 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0e6b7fa5-2803-42ff-ae6a-abc49aa09080 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:53.766793 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0e6b7fa5-2803-42ff-ae6a-abc49aa09080 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:53.895748 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-0e6b7fa5-2803-42ff-ae6a-abc49aa09080 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:53.904820 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-0e6b7fa5-2803-42ff-ae6a-abc49aa09080 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:53.906322 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-0e6b7fa5-2803-42ff-ae6a-abc49aa09080 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:53.907547 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-0e6b7fa5-2803-42ff-ae6a-abc49aa09080 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1810 microversion: 2.20 time: 0.153980 Nov 15 12:43:53.908109 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 345/660] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:53 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:53.974103 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-a0cca382-f6e1-4ae1-9f5d-536fe76b161e tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:53.974715 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-a0cca382-f6e1-4ae1-9f5d-536fe76b161e tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 11603efa-1f82-404a-9f04-bf3b2efb2905] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:53.981064 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a0cca382-f6e1-4ae1-9f5d-536fe76b161e tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:53.981506 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a0cca382-f6e1-4ae1-9f5d-536fe76b161e tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:53.982272 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a0cca382-f6e1-4ae1-9f5d-536fe76b161e tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:53.982697 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a0cca382-f6e1-4ae1-9f5d-536fe76b161e tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:54.041911 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-a0cca382-f6e1-4ae1-9f5d-536fe76b161e tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635a7f2e64b64ab0be3a8a9270c0cadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff96d81628ad4a9a884766ce86b9c684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:54.046363 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-75f09a13-8dca-4a23-a849-adc9b6ad10e2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:54.047273 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-75f09a13-8dca-4a23-a849-adc9b6ad10e2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:54.049502 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-a0cca382-f6e1-4ae1-9f5d-536fe76b161e tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "GET /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905" status: 200 len: 1218 microversion: 2.1 time: 0.079064 Nov 15 12:43:54.050071 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 316/661] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:53 2021] GET /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:54.052972 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-75f09a13-8dca-4a23-a849-adc9b6ad10e2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:54.053412 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-75f09a13-8dca-4a23-a849-adc9b6ad10e2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:54.054180 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-75f09a13-8dca-4a23-a849-adc9b6ad10e2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:54.054606 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-75f09a13-8dca-4a23-a849-adc9b6ad10e2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:54.192544 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-75f09a13-8dca-4a23-a849-adc9b6ad10e2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:54.200848 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-75f09a13-8dca-4a23-a849-adc9b6ad10e2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1663 microversion: 2.1 time: 0.157988 Nov 15 12:43:54.201847 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 346/662] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:54 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1663 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:43:54.926636 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-63a82fd1-ce55-4407-a9d5-3c0e4f59d5cc tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:54.927279 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-63a82fd1-ce55-4407-a9d5-3c0e4f59d5cc tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:54.934070 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-63a82fd1-ce55-4407-a9d5-3c0e4f59d5cc tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:54.934509 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-63a82fd1-ce55-4407-a9d5-3c0e4f59d5cc tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:54.935323 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-63a82fd1-ce55-4407-a9d5-3c0e4f59d5cc tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:54.935742 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-63a82fd1-ce55-4407-a9d5-3c0e4f59d5cc tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:55.066534 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-b0645f8f-4ad9-4dc9-84c1-cdf4942ad990 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:55.067214 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-b0645f8f-4ad9-4dc9-84c1-cdf4942ad990 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 11603efa-1f82-404a-9f04-bf3b2efb2905] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:55.070257 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-63a82fd1-ce55-4407-a9d5-3c0e4f59d5cc tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:55.073796 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b0645f8f-4ad9-4dc9-84c1-cdf4942ad990 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:55.074242 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b0645f8f-4ad9-4dc9-84c1-cdf4942ad990 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:55.075038 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b0645f8f-4ad9-4dc9-84c1-cdf4942ad990 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:55.075476 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b0645f8f-4ad9-4dc9-84c1-cdf4942ad990 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:55.079271 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-63a82fd1-ce55-4407-a9d5-3c0e4f59d5cc tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:55.080810 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-63a82fd1-ce55-4407-a9d5-3c0e4f59d5cc tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:55.082057 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-63a82fd1-ce55-4407-a9d5-3c0e4f59d5cc tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1810 microversion: 2.20 time: 0.159081 Nov 15 12:43:55.082620 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 317/663] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:54 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:55.139357 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-b0645f8f-4ad9-4dc9-84c1-cdf4942ad990 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635a7f2e64b64ab0be3a8a9270c0cadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff96d81628ad4a9a884766ce86b9c684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:55.146574 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-b0645f8f-4ad9-4dc9-84c1-cdf4942ad990 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "GET /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905" status: 200 len: 1218 microversion: 2.1 time: 0.083672 Nov 15 12:43:55.147167 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 347/664] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:55 2021] GET /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:43:55.218465 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-55230b3d-434d-418f-87ed-315fcc6e9af9 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:55.219349 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-55230b3d-434d-418f-87ed-315fcc6e9af9 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:55.225453 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-55230b3d-434d-418f-87ed-315fcc6e9af9 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:55.225902 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-55230b3d-434d-418f-87ed-315fcc6e9af9 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:55.226697 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-55230b3d-434d-418f-87ed-315fcc6e9af9 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:55.227351 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-55230b3d-434d-418f-87ed-315fcc6e9af9 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:55.456180 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-55230b3d-434d-418f-87ed-315fcc6e9af9 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:55.465271 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-55230b3d-434d-418f-87ed-315fcc6e9af9 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1663 microversion: 2.1 time: 0.250410 Nov 15 12:43:55.465968 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 318/665] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:55 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1663 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:43:56.101103 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-7b2735be-9101-4b47-91d0-cddb26ea08e4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:56.102051 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-7b2735be-9101-4b47-91d0-cddb26ea08e4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:56.109326 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7b2735be-9101-4b47-91d0-cddb26ea08e4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:56.110358 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7b2735be-9101-4b47-91d0-cddb26ea08e4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:56.111274 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7b2735be-9101-4b47-91d0-cddb26ea08e4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:56.111823 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7b2735be-9101-4b47-91d0-cddb26ea08e4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:56.120243 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-1bd4fcf6-4e4a-41a3-8d0d-31f842b28426 req-686a9bb3-230e-49ad-a8d5-95cfcbcfc767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11daa0bc-1e25-47d7-a6df-ffc808e1ff58", "name": "network-vif-plugged", "status": "completed", "tag": "7a90a770-a011-4cb6-9fcf-893773b8d120"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:43:56.121833 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:43:56.121833 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:43:56.130253 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-1bd4fcf6-4e4a-41a3-8d0d-31f842b28426 req-686a9bb3-230e-49ad-a8d5-95cfcbcfc767 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:56.131026 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-1bd4fcf6-4e4a-41a3-8d0d-31f842b28426 req-686a9bb3-230e-49ad-a8d5-95cfcbcfc767 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:56.144620 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-1bd4fcf6-4e4a-41a3-8d0d-31f842b28426 req-686a9bb3-230e-49ad-a8d5-95cfcbcfc767 service nova] Creating event network-vif-plugged:7a90a770-a011-4cb6-9fcf-893773b8d120 for instance 11daa0bc-1e25-47d7-a6df-ffc808e1ff58 on hv-cinder-68088 Nov 15 12:43:56.150982 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-1bd4fcf6-4e4a-41a3-8d0d-31f842b28426 req-686a9bb3-230e-49ad-a8d5-95cfcbcfc767 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035125 Nov 15 12:43:56.152346 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 319/666] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:43:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 15 12:43:56.166285 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-b5e46bdd-0653-4eb0-9ffc-9c152865db6e tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:56.167455 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-b5e46bdd-0653-4eb0-9ffc-9c152865db6e tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 11603efa-1f82-404a-9f04-bf3b2efb2905] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:56.175177 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b5e46bdd-0653-4eb0-9ffc-9c152865db6e tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:56.175790 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b5e46bdd-0653-4eb0-9ffc-9c152865db6e tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:56.176861 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b5e46bdd-0653-4eb0-9ffc-9c152865db6e tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:56.177520 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b5e46bdd-0653-4eb0-9ffc-9c152865db6e tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:56.259904 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-b5e46bdd-0653-4eb0-9ffc-9c152865db6e tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635a7f2e64b64ab0be3a8a9270c0cadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff96d81628ad4a9a884766ce86b9c684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:56.268426 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-b5e46bdd-0653-4eb0-9ffc-9c152865db6e tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "GET /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905" status: 200 len: 1272 microversion: 2.1 time: 0.107411 Nov 15 12:43:56.269322 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 320/667] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:56 2021] GET /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905 => generated 1272 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:43:56.341607 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-7b2735be-9101-4b47-91d0-cddb26ea08e4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:56.350101 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-7b2735be-9101-4b47-91d0-cddb26ea08e4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:56.351667 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-7b2735be-9101-4b47-91d0-cddb26ea08e4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:56.352837 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-7b2735be-9101-4b47-91d0-cddb26ea08e4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1810 microversion: 2.20 time: 0.255644 Nov 15 12:43:56.354156 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 348/668] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:56 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1810 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:56.483583 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-fd01f0d2-80bf-490d-9c52-7bdbda3cdb2a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:56.484197 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-fd01f0d2-80bf-490d-9c52-7bdbda3cdb2a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:56.492056 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fd01f0d2-80bf-490d-9c52-7bdbda3cdb2a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:56.492787 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fd01f0d2-80bf-490d-9c52-7bdbda3cdb2a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:56.493582 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fd01f0d2-80bf-490d-9c52-7bdbda3cdb2a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:56.494956 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fd01f0d2-80bf-490d-9c52-7bdbda3cdb2a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:56.655540 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-fd01f0d2-80bf-490d-9c52-7bdbda3cdb2a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:56.662990 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-fd01f0d2-80bf-490d-9c52-7bdbda3cdb2a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1663 microversion: 2.1 time: 0.183224 Nov 15 12:43:56.663577 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 321/669] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:56 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1663 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:57.285934 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-60653910-ba05-43e2-bcf4-ec29430a9140 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:57.286544 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-60653910-ba05-43e2-bcf4-ec29430a9140 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 11603efa-1f82-404a-9f04-bf3b2efb2905] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:57.293408 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-60653910-ba05-43e2-bcf4-ec29430a9140 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:57.293867 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-60653910-ba05-43e2-bcf4-ec29430a9140 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:57.294700 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-60653910-ba05-43e2-bcf4-ec29430a9140 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:57.295166 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-60653910-ba05-43e2-bcf4-ec29430a9140 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:57.380336 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-a534b665-8ae6-4164-a9b5-2a005519e364 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:57.381816 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-a534b665-8ae6-4164-a9b5-2a005519e364 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:57.392128 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a534b665-8ae6-4164-a9b5-2a005519e364 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:57.393055 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a534b665-8ae6-4164-a9b5-2a005519e364 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:57.394133 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a534b665-8ae6-4164-a9b5-2a005519e364 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:57.394834 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a534b665-8ae6-4164-a9b5-2a005519e364 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:57.495794 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-60653910-ba05-43e2-bcf4-ec29430a9140 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635a7f2e64b64ab0be3a8a9270c0cadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff96d81628ad4a9a884766ce86b9c684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:57.503251 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-60653910-ba05-43e2-bcf4-ec29430a9140 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "GET /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905" status: 200 len: 1314 microversion: 2.1 time: 0.221015 Nov 15 12:43:57.503832 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 349/670] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:57 2021] GET /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:57.508078 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [req-df94f9b8-fdbc-4608-a7f5-68f26d12c6ee req-9d486f46-385a-4e77-8fb0-4b84b0d82b1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11603efa-1f82-404a-9f04-bf3b2efb2905", "tag": "91f8689a-c33d-4d2a-b3f7-77685467e63f"}]} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:43:57.510233 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:43:57.510233 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: warnings.warn(msg) Nov 15 12:43:57.518110 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-df94f9b8-fdbc-4608-a7f5-68f26d12c6ee req-9d486f46-385a-4e77-8fb0-4b84b0d82b1a service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:57.518893 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-df94f9b8-fdbc-4608-a7f5-68f26d12c6ee req-9d486f46-385a-4e77-8fb0-4b84b0d82b1a service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:57.530366 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.compute.server_external_events [req-df94f9b8-fdbc-4608-a7f5-68f26d12c6ee req-9d486f46-385a-4e77-8fb0-4b84b0d82b1a service nova] Creating event network-changed:91f8689a-c33d-4d2a-b3f7-77685467e63f for instance 11603efa-1f82-404a-9f04-bf3b2efb2905 on hv-cinder-68088 Nov 15 12:43:57.539647 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [req-df94f9b8-fdbc-4608-a7f5-68f26d12c6ee req-9d486f46-385a-4e77-8fb0-4b84b0d82b1a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033962 Nov 15 12:43:57.540981 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 350/671] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:43:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:43:57.563167 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-a534b665-8ae6-4164-a9b5-2a005519e364 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:57.573398 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-a534b665-8ae6-4164-a9b5-2a005519e364 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:57.574972 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-a534b665-8ae6-4164-a9b5-2a005519e364 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:57.576177 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-a534b665-8ae6-4164-a9b5-2a005519e364 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1810 microversion: 2.20 time: 0.206027 Nov 15 12:43:57.576742 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 322/672] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:57 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1810 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:43:57.682416 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-87716e82-90f9-43c6-8f64-fdcb53af2e31 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:57.683273 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-87716e82-90f9-43c6-8f64-fdcb53af2e31 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:57.689330 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-87716e82-90f9-43c6-8f64-fdcb53af2e31 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:57.689782 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-87716e82-90f9-43c6-8f64-fdcb53af2e31 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:57.690564 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-87716e82-90f9-43c6-8f64-fdcb53af2e31 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:57.691043 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-87716e82-90f9-43c6-8f64-fdcb53af2e31 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:57.830134 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-87716e82-90f9-43c6-8f64-fdcb53af2e31 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:57.837914 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-87716e82-90f9-43c6-8f64-fdcb53af2e31 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1667 microversion: 2.1 time: 0.159860 Nov 15 12:43:57.838508 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 351/673] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:57 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1667 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:58.521684 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-07600214-f741-455b-ac3e-bdd6ff290cee tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:58.522376 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-07600214-f741-455b-ac3e-bdd6ff290cee tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 11603efa-1f82-404a-9f04-bf3b2efb2905] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:58.529771 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-07600214-f741-455b-ac3e-bdd6ff290cee tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:58.530482 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-07600214-f741-455b-ac3e-bdd6ff290cee tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:58.531251 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-07600214-f741-455b-ac3e-bdd6ff290cee tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:58.531761 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-07600214-f741-455b-ac3e-bdd6ff290cee tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:58.596137 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-a8b6d930-75e4-4a93-a37e-2adfec0fac54 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:58.596740 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-a8b6d930-75e4-4a93-a37e-2adfec0fac54 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:58.604433 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a8b6d930-75e4-4a93-a37e-2adfec0fac54 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:58.604830 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a8b6d930-75e4-4a93-a37e-2adfec0fac54 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:58.605624 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a8b6d930-75e4-4a93-a37e-2adfec0fac54 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:58.606051 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a8b6d930-75e4-4a93-a37e-2adfec0fac54 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:58.728186 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-07600214-f741-455b-ac3e-bdd6ff290cee tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635a7f2e64b64ab0be3a8a9270c0cadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff96d81628ad4a9a884766ce86b9c684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:58.741792 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-07600214-f741-455b-ac3e-bdd6ff290cee tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "GET /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905" status: 200 len: 1314 microversion: 2.1 time: 0.224547 Nov 15 12:43:58.742397 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 323/674] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:58 2021] GET /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:58.791103 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-a8b6d930-75e4-4a93-a37e-2adfec0fac54 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:58.799749 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-a8b6d930-75e4-4a93-a37e-2adfec0fac54 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:58.801334 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-a8b6d930-75e4-4a93-a37e-2adfec0fac54 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:58.802598 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-a8b6d930-75e4-4a93-a37e-2adfec0fac54 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1810 microversion: 2.20 time: 0.211082 Nov 15 12:43:58.803253 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 352/675] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:58 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1810 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 15 12:43:59.560082 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-22368f06-2d34-4ad6-b010-09fbfc126aec tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:59.560560 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-22368f06-2d34-4ad6-b010-09fbfc126aec tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: ec023efe-8c28-4d57-a7a1-eb10caa7a723] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:59.566856 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-22368f06-2d34-4ad6-b010-09fbfc126aec tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:59.567299 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-22368f06-2d34-4ad6-b010-09fbfc126aec tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:59.568073 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-22368f06-2d34-4ad6-b010-09fbfc126aec tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:59.568499 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-22368f06-2d34-4ad6-b010-09fbfc126aec tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:59.646165 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.objects.instance [None req-22368f06-2d34-4ad6-b010-09fbfc126aec tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lazy-loading 'services' on Instance uuid ec023efe-8c28-4d57-a7a1-eb10caa7a723 {{(pid=122568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 15 12:43:59.724771 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-22368f06-2d34-4ad6-b010-09fbfc126aec tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ec023efe-8c28-4d57-a7a1-eb10caa7a723/os-volume_attachments/827cd906-24d4-4b6f-acc1-0754a05d0d98" status: 202 len: 0 microversion: 2.1 time: 0.168911 Nov 15 12:43:59.725382 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 324/676] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Nov 15 12:43:59 2021] DELETE /compute/v2.1/servers/ec023efe-8c28-4d57-a7a1-eb10caa7a723/os-volume_attachments/827cd906-24d4-4b6f-acc1-0754a05d0d98 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:43:59.758012 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-1aa71e4d-9290-4c66-9eb2-886e81061002 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:59.758650 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-1aa71e4d-9290-4c66-9eb2-886e81061002 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 11603efa-1f82-404a-9f04-bf3b2efb2905] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:59.765145 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1aa71e4d-9290-4c66-9eb2-886e81061002 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:59.765867 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1aa71e4d-9290-4c66-9eb2-886e81061002 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:59.767123 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1aa71e4d-9290-4c66-9eb2-886e81061002 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:59.767709 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1aa71e4d-9290-4c66-9eb2-886e81061002 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:59.822502 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-74e842d8-17fb-4541-981b-4e9ae815f441 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:43:59.823451 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-74e842d8-17fb-4541-981b-4e9ae815f441 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:43:59.829784 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-74e842d8-17fb-4541-981b-4e9ae815f441 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:59.830234 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-74e842d8-17fb-4541-981b-4e9ae815f441 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:59.831315 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-74e842d8-17fb-4541-981b-4e9ae815f441 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:43:59.831748 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-74e842d8-17fb-4541-981b-4e9ae815f441 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:43:59.936334 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-1aa71e4d-9290-4c66-9eb2-886e81061002 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635a7f2e64b64ab0be3a8a9270c0cadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff96d81628ad4a9a884766ce86b9c684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:43:59.943738 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-1aa71e4d-9290-4c66-9eb2-886e81061002 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "GET /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905" status: 200 len: 1314 microversion: 2.1 time: 0.189434 Nov 15 12:43:59.944740 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 353/677] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:43:59 2021] GET /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:43:59.998017 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-74e842d8-17fb-4541-981b-4e9ae815f441 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:00.006881 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-74e842d8-17fb-4541-981b-4e9ae815f441 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:00.008461 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-74e842d8-17fb-4541-981b-4e9ae815f441 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:00.009994 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-74e842d8-17fb-4541-981b-4e9ae815f441 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1797 microversion: 2.20 time: 0.191989 Nov 15 12:44:00.010638 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 325/678] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:43:59 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1797 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 15 12:44:00.842577 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e48f64a6-7b6f-4004-85cb-99f9a8582499 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:00.843122 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e48f64a6-7b6f-4004-85cb-99f9a8582499 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: ec023efe-8c28-4d57-a7a1-eb10caa7a723] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:00.849487 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e48f64a6-7b6f-4004-85cb-99f9a8582499 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:00.849935 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e48f64a6-7b6f-4004-85cb-99f9a8582499 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:00.850723 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e48f64a6-7b6f-4004-85cb-99f9a8582499 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:00.851193 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e48f64a6-7b6f-4004-85cb-99f9a8582499 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:00.876218 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e48f64a6-7b6f-4004-85cb-99f9a8582499 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: ec023efe-8c28-4d57-a7a1-eb10caa7a723] Going to try to terminate instance {{(pid=122567) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 15 12:44:00.958463 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e48f64a6-7b6f-4004-85cb-99f9a8582499 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ec023efe-8c28-4d57-a7a1-eb10caa7a723" status: 204 len: 0 microversion: 2.1 time: 0.120017 Nov 15 12:44:00.959398 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 354/679] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Nov 15 12:44:00 2021] DELETE /compute/v2.1/servers/ec023efe-8c28-4d57-a7a1-eb10caa7a723 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 15 12:44:00.960902 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-1c777c08-57ff-4864-bd4b-f7679e0f36fc tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:00.962042 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-1c777c08-57ff-4864-bd4b-f7679e0f36fc tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 11603efa-1f82-404a-9f04-bf3b2efb2905] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:00.969600 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1c777c08-57ff-4864-bd4b-f7679e0f36fc tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:00.970045 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1c777c08-57ff-4864-bd4b-f7679e0f36fc tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:00.970881 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1c777c08-57ff-4864-bd4b-f7679e0f36fc tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:00.970999 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-712a2e26-5e65-414d-acf0-ed92d02ade57 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:00.971314 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1c777c08-57ff-4864-bd4b-f7679e0f36fc tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:00.971572 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-712a2e26-5e65-414d-acf0-ed92d02ade57 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: ec023efe-8c28-4d57-a7a1-eb10caa7a723] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:00.977336 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-712a2e26-5e65-414d-acf0-ed92d02ade57 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:00.977776 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-712a2e26-5e65-414d-acf0-ed92d02ade57 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:00.978542 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-712a2e26-5e65-414d-acf0-ed92d02ade57 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:00.978997 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-712a2e26-5e65-414d-acf0-ed92d02ade57 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:01.173997 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-1c777c08-57ff-4864-bd4b-f7679e0f36fc tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635a7f2e64b64ab0be3a8a9270c0cadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff96d81628ad4a9a884766ce86b9c684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:01.177369 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-712a2e26-5e65-414d-acf0-ed92d02ade57 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44c99bd2e434807b12facc77f18a5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aae5c632c8b4d4f94206b1d6745c0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:01.182221 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-1c777c08-57ff-4864-bd4b-f7679e0f36fc tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "GET /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905" status: 200 len: 1314 microversion: 2.1 time: 0.224864 Nov 15 12:44:01.183299 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 326/680] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:44:00 2021] GET /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:44:01.185609 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-712a2e26-5e65-414d-acf0-ed92d02ade57 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "GET /compute/v2.1/servers/ec023efe-8c28-4d57-a7a1-eb10caa7a723" status: 200 len: 1514 microversion: 2.1 time: 0.219136 Nov 15 12:44:01.186171 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 355/681] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:44:00 2021] GET /compute/v2.1/servers/ec023efe-8c28-4d57-a7a1-eb10caa7a723 => generated 1514 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:44:02.142269 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-d2c1c156-5234-4af8-875b-5b2d0010072f req-99ed6061-beb1-422d-a8c2-03637d336c34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11603efa-1f82-404a-9f04-bf3b2efb2905", "name": "network-vif-plugged", "status": "completed", "tag": "91f8689a-c33d-4d2a-b3f7-77685467e63f"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:44:02.144012 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:44:02.144012 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:44:02.152008 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-d2c1c156-5234-4af8-875b-5b2d0010072f req-99ed6061-beb1-422d-a8c2-03637d336c34 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:02.152450 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-d2c1c156-5234-4af8-875b-5b2d0010072f req-99ed6061-beb1-422d-a8c2-03637d336c34 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:02.163333 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-d2c1c156-5234-4af8-875b-5b2d0010072f req-99ed6061-beb1-422d-a8c2-03637d336c34 service nova] Creating event network-vif-plugged:91f8689a-c33d-4d2a-b3f7-77685467e63f for instance 11603efa-1f82-404a-9f04-bf3b2efb2905 on hv-cinder-68088 Nov 15 12:44:02.169020 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-d2c1c156-5234-4af8-875b-5b2d0010072f req-99ed6061-beb1-422d-a8c2-03637d336c34 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030175 Nov 15 12:44:02.169903 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 327/682] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:44:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:44:02.201093 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-725e81eb-5b33-45f1-97e5-7fa6fa9614c5 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:02.202307 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-725e81eb-5b33-45f1-97e5-7fa6fa9614c5 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 11603efa-1f82-404a-9f04-bf3b2efb2905] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:02.203238 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-fd0e4fac-11ed-411f-8c8f-0f68dd7dcfc9 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:02.204021 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-fd0e4fac-11ed-411f-8c8f-0f68dd7dcfc9 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: ec023efe-8c28-4d57-a7a1-eb10caa7a723] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:02.212195 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-725e81eb-5b33-45f1-97e5-7fa6fa9614c5 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:02.213330 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-725e81eb-5b33-45f1-97e5-7fa6fa9614c5 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:02.214129 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-725e81eb-5b33-45f1-97e5-7fa6fa9614c5 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:02.214560 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-725e81eb-5b33-45f1-97e5-7fa6fa9614c5 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:02.218183 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fd0e4fac-11ed-411f-8c8f-0f68dd7dcfc9 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:02.218622 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fd0e4fac-11ed-411f-8c8f-0f68dd7dcfc9 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:02.219420 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fd0e4fac-11ed-411f-8c8f-0f68dd7dcfc9 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:02.220039 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fd0e4fac-11ed-411f-8c8f-0f68dd7dcfc9 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:02.422117 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-725e81eb-5b33-45f1-97e5-7fa6fa9614c5 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635a7f2e64b64ab0be3a8a9270c0cadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff96d81628ad4a9a884766ce86b9c684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:02.427647 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-fd0e4fac-11ed-411f-8c8f-0f68dd7dcfc9 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44c99bd2e434807b12facc77f18a5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aae5c632c8b4d4f94206b1d6745c0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:02.432479 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-725e81eb-5b33-45f1-97e5-7fa6fa9614c5 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "GET /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905" status: 200 len: 1314 microversion: 2.1 time: 0.236941 Nov 15 12:44:02.433390 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 356/683] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:44:02 2021] GET /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:44:02.439693 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-fd0e4fac-11ed-411f-8c8f-0f68dd7dcfc9 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "GET /compute/v2.1/servers/ec023efe-8c28-4d57-a7a1-eb10caa7a723" status: 200 len: 1514 microversion: 2.1 time: 0.239974 Nov 15 12:44:02.440925 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 328/684] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:44:02 2021] GET /compute/v2.1/servers/ec023efe-8c28-4d57-a7a1-eb10caa7a723 => generated 1514 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:44:03.449573 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-d307efc9-0503-4f48-b187-073d1f6e9a26 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:03.450178 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-d307efc9-0503-4f48-b187-073d1f6e9a26 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 11603efa-1f82-404a-9f04-bf3b2efb2905] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:03.456713 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d307efc9-0503-4f48-b187-073d1f6e9a26 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:03.457158 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d307efc9-0503-4f48-b187-073d1f6e9a26 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:03.457929 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d307efc9-0503-4f48-b187-073d1f6e9a26 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:03.458353 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d307efc9-0503-4f48-b187-073d1f6e9a26 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:03.458607 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-44a84efd-f054-480c-9184-473e7cfe10c9 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:03.459247 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-44a84efd-f054-480c-9184-473e7cfe10c9 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: ec023efe-8c28-4d57-a7a1-eb10caa7a723] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:03.466043 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-44a84efd-f054-480c-9184-473e7cfe10c9 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:03.466499 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-44a84efd-f054-480c-9184-473e7cfe10c9 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:03.467309 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-44a84efd-f054-480c-9184-473e7cfe10c9 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:03.467737 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-44a84efd-f054-480c-9184-473e7cfe10c9 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:03.669184 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-44a84efd-f054-480c-9184-473e7cfe10c9 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44c99bd2e434807b12facc77f18a5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aae5c632c8b4d4f94206b1d6745c0ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:03.674490 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-d307efc9-0503-4f48-b187-073d1f6e9a26 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635a7f2e64b64ab0be3a8a9270c0cadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff96d81628ad4a9a884766ce86b9c684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:03.676933 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-44a84efd-f054-480c-9184-473e7cfe10c9 tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "GET /compute/v2.1/servers/ec023efe-8c28-4d57-a7a1-eb10caa7a723" status: 200 len: 1514 microversion: 2.1 time: 0.222271 Nov 15 12:44:03.677516 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 329/685] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:44:03 2021] GET /compute/v2.1/servers/ec023efe-8c28-4d57-a7a1-eb10caa7a723 => generated 1514 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:44:03.682824 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-71a25076-f683-44f8-95b4-d04cfdc30f1f req-08e1ecb9-c7cc-4708-b115-d98c9ce04400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec023efe-8c28-4d57-a7a1-eb10caa7a723", "name": "network-vif-deleted", "tag": "fb7fc7e4-f6f7-4eb4-b137-cfec4ac39bd8"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:44:03.684362 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:44:03.684362 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:44:03.693865 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-71a25076-f683-44f8-95b4-d04cfdc30f1f req-08e1ecb9-c7cc-4708-b115-d98c9ce04400 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:03.693865 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-71a25076-f683-44f8-95b4-d04cfdc30f1f req-08e1ecb9-c7cc-4708-b115-d98c9ce04400 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:03.705690 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-d307efc9-0503-4f48-b187-073d1f6e9a26 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "GET /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905" status: 200 len: 1314 microversion: 2.1 time: 0.256818 Nov 15 12:44:03.709153 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-71a25076-f683-44f8-95b4-d04cfdc30f1f req-08e1ecb9-c7cc-4708-b115-d98c9ce04400 service nova] Creating event network-vif-deleted:fb7fc7e4-f6f7-4eb4-b137-cfec4ac39bd8 for instance ec023efe-8c28-4d57-a7a1-eb10caa7a723 on hv-cinder-68088 Nov 15 12:44:03.716470 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 357/686] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:44:03 2021] GET /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:44:03.718409 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-71a25076-f683-44f8-95b4-d04cfdc30f1f req-08e1ecb9-c7cc-4708-b115-d98c9ce04400 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039408 Nov 15 12:44:03.719116 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 330/687] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:44:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:44:04.697857 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-5ed54ccd-5187-41da-b2a1-14c09abdc5ac tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:04.698637 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-5ed54ccd-5187-41da-b2a1-14c09abdc5ac tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] [instance: ec023efe-8c28-4d57-a7a1-eb10caa7a723] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:04.704702 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5ed54ccd-5187-41da-b2a1-14c09abdc5ac tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:04.705136 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5ed54ccd-5187-41da-b2a1-14c09abdc5ac tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:04.705895 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5ed54ccd-5187-41da-b2a1-14c09abdc5ac tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:04.706331 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5ed54ccd-5187-41da-b2a1-14c09abdc5ac tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:04.720007 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.wsgi [None req-5ed54ccd-5187-41da-b2a1-14c09abdc5ac tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] HTTP exception thrown: Instance ec023efe-8c28-4d57-a7a1-eb10caa7a723 could not be found. Nov 15 12:44:04.720590 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-5ed54ccd-5187-41da-b2a1-14c09abdc5ac tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] Returning 404 to user: Instance ec023efe-8c28-4d57-a7a1-eb10caa7a723 could not be found. {{(pid=122567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:44:04.721400 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-5ed54ccd-5187-41da-b2a1-14c09abdc5ac tempest-VolumesSnapshotTestJSON-432847973 tempest-VolumesSnapshotTestJSON-432847973-project] 10.222.0.43 "GET /compute/v2.1/servers/ec023efe-8c28-4d57-a7a1-eb10caa7a723" status: 404 len: 111 microversion: 2.1 time: 0.027876 Nov 15 12:44:04.721939 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 358/688] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:44:04 2021] GET /compute/v2.1/servers/ec023efe-8c28-4d57-a7a1-eb10caa7a723 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 15 12:44:04.723595 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-efede184-6d3a-4d1f-8087-1ebf135afb18 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:04.724318 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-efede184-6d3a-4d1f-8087-1ebf135afb18 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 11603efa-1f82-404a-9f04-bf3b2efb2905] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:04.730537 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-efede184-6d3a-4d1f-8087-1ebf135afb18 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:04.731006 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-efede184-6d3a-4d1f-8087-1ebf135afb18 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:04.731796 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-efede184-6d3a-4d1f-8087-1ebf135afb18 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:04.732216 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-efede184-6d3a-4d1f-8087-1ebf135afb18 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:04.878888 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-efede184-6d3a-4d1f-8087-1ebf135afb18 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635a7f2e64b64ab0be3a8a9270c0cadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff96d81628ad4a9a884766ce86b9c684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:04.887729 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-efede184-6d3a-4d1f-8087-1ebf135afb18 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "GET /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905" status: 200 len: 1499 microversion: 2.1 time: 0.168548 Nov 15 12:44:04.888313 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 331/689] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:44:04 2021] GET /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905 => generated 1499 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:44:05.610235 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-90effd3a-c72d-43cf-b5f8-6cbfe85c79f5 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:05.610734 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-90effd3a-c72d-43cf-b5f8-6cbfe85c79f5 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 11603efa-1f82-404a-9f04-bf3b2efb2905] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:05.616809 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-90effd3a-c72d-43cf-b5f8-6cbfe85c79f5 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:05.617249 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-90effd3a-c72d-43cf-b5f8-6cbfe85c79f5 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:05.618038 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-90effd3a-c72d-43cf-b5f8-6cbfe85c79f5 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:05.618481 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-90effd3a-c72d-43cf-b5f8-6cbfe85c79f5 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:05.643643 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-90effd3a-c72d-43cf-b5f8-6cbfe85c79f5 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 11603efa-1f82-404a-9f04-bf3b2efb2905] Going to try to terminate instance {{(pid=122567) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 15 12:44:05.730592 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-90effd3a-c72d-43cf-b5f8-6cbfe85c79f5 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "DELETE /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905" status: 204 len: 0 microversion: 2.1 time: 0.123309 Nov 15 12:44:05.731667 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 359/690] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Nov 15 12:44:05 2021] DELETE /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 15 12:44:05.741332 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-eeb5cf2a-0d7b-4fe3-925b-27dad75c4807 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:05.742334 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-eeb5cf2a-0d7b-4fe3-925b-27dad75c4807 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 11603efa-1f82-404a-9f04-bf3b2efb2905] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:05.749975 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-eeb5cf2a-0d7b-4fe3-925b-27dad75c4807 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:05.750425 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-eeb5cf2a-0d7b-4fe3-925b-27dad75c4807 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:05.751258 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-eeb5cf2a-0d7b-4fe3-925b-27dad75c4807 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:05.751691 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-eeb5cf2a-0d7b-4fe3-925b-27dad75c4807 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:05.891042 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-eeb5cf2a-0d7b-4fe3-925b-27dad75c4807 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635a7f2e64b64ab0be3a8a9270c0cadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff96d81628ad4a9a884766ce86b9c684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:05.898339 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-eeb5cf2a-0d7b-4fe3-925b-27dad75c4807 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "GET /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905" status: 200 len: 1505 microversion: 2.1 time: 0.162168 Nov 15 12:44:05.898928 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 332/691] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:44:05 2021] GET /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905 => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:44:06.916464 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-30954dfe-b93e-4827-bdd4-0bfd356d88eb tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:06.917327 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-30954dfe-b93e-4827-bdd4-0bfd356d88eb tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 11603efa-1f82-404a-9f04-bf3b2efb2905] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:06.923870 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-30954dfe-b93e-4827-bdd4-0bfd356d88eb tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:06.924302 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-30954dfe-b93e-4827-bdd4-0bfd356d88eb tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:06.925067 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-30954dfe-b93e-4827-bdd4-0bfd356d88eb tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:06.925492 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-30954dfe-b93e-4827-bdd4-0bfd356d88eb tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:07.055173 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-30954dfe-b93e-4827-bdd4-0bfd356d88eb tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635a7f2e64b64ab0be3a8a9270c0cadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff96d81628ad4a9a884766ce86b9c684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:07.063458 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-30954dfe-b93e-4827-bdd4-0bfd356d88eb tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "GET /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905" status: 200 len: 1505 microversion: 2.1 time: 0.151151 Nov 15 12:44:07.064044 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 360/692] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:44:06 2021] GET /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:44:08.081677 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-059fed5b-7a01-4374-a535-0e25e57439dc tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:08.082361 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-059fed5b-7a01-4374-a535-0e25e57439dc tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 11603efa-1f82-404a-9f04-bf3b2efb2905] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:08.088775 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-059fed5b-7a01-4374-a535-0e25e57439dc tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:08.089211 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-059fed5b-7a01-4374-a535-0e25e57439dc tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:08.089968 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-059fed5b-7a01-4374-a535-0e25e57439dc tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:08.090390 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-059fed5b-7a01-4374-a535-0e25e57439dc tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:08.219452 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-059fed5b-7a01-4374-a535-0e25e57439dc tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635a7f2e64b64ab0be3a8a9270c0cadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff96d81628ad4a9a884766ce86b9c684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:08.227007 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-059fed5b-7a01-4374-a535-0e25e57439dc tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "GET /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905" status: 200 len: 1505 microversion: 2.1 time: 0.149060 Nov 15 12:44:08.236386 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 333/693] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:44:08 2021] GET /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905 => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:44:09.244715 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-1e5571f7-1660-49fc-bab4-37ad32e03acf tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:09.245314 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-1e5571f7-1660-49fc-bab4-37ad32e03acf tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 11603efa-1f82-404a-9f04-bf3b2efb2905] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:09.251317 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1e5571f7-1660-49fc-bab4-37ad32e03acf tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:09.251754 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1e5571f7-1660-49fc-bab4-37ad32e03acf tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:09.252515 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1e5571f7-1660-49fc-bab4-37ad32e03acf tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:09.252939 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1e5571f7-1660-49fc-bab4-37ad32e03acf tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:09.611760 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-1e5571f7-1660-49fc-bab4-37ad32e03acf tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635a7f2e64b64ab0be3a8a9270c0cadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff96d81628ad4a9a884766ce86b9c684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:09.619756 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-1e5571f7-1660-49fc-bab4-37ad32e03acf tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "GET /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905" status: 200 len: 1505 microversion: 2.1 time: 0.379431 Nov 15 12:44:09.620334 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 361/694] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:44:09 2021] GET /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905 => generated 1505 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:44:10.255704 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-72806853-8e2e-495b-b309-b40bc18f8b2c req-dcd039b9-f1bf-4a28-aefa-fbda3846b866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11603efa-1f82-404a-9f04-bf3b2efb2905", "name": "network-vif-deleted", "tag": "91f8689a-c33d-4d2a-b3f7-77685467e63f"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:44:10.257579 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:44:10.257579 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:44:10.266283 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-72806853-8e2e-495b-b309-b40bc18f8b2c req-dcd039b9-f1bf-4a28-aefa-fbda3846b866 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:10.266720 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-72806853-8e2e-495b-b309-b40bc18f8b2c req-dcd039b9-f1bf-4a28-aefa-fbda3846b866 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:10.279055 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-72806853-8e2e-495b-b309-b40bc18f8b2c req-dcd039b9-f1bf-4a28-aefa-fbda3846b866 service nova] Creating event network-vif-deleted:91f8689a-c33d-4d2a-b3f7-77685467e63f for instance 11603efa-1f82-404a-9f04-bf3b2efb2905 on hv-cinder-68088 Nov 15 12:44:10.284330 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-72806853-8e2e-495b-b309-b40bc18f8b2c req-dcd039b9-f1bf-4a28-aefa-fbda3846b866 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032175 Nov 15 12:44:10.284930 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 334/695] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:44:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:44:10.637361 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-c8b307fe-fdf5-4c37-a063-3d63fbc79bad tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:10.637975 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-c8b307fe-fdf5-4c37-a063-3d63fbc79bad tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 11603efa-1f82-404a-9f04-bf3b2efb2905] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:10.645256 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c8b307fe-fdf5-4c37-a063-3d63fbc79bad tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:10.645802 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c8b307fe-fdf5-4c37-a063-3d63fbc79bad tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:10.646674 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c8b307fe-fdf5-4c37-a063-3d63fbc79bad tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:10.647140 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c8b307fe-fdf5-4c37-a063-3d63fbc79bad tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:10.682614 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c8b307fe-fdf5-4c37-a063-3d63fbc79bad tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:10.683085 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c8b307fe-fdf5-4c37-a063-3d63fbc79bad tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:10.683537 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.objects.instance [None req-c8b307fe-fdf5-4c37-a063-3d63fbc79bad tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lazy-loading 'fault' on Instance uuid 11603efa-1f82-404a-9f04-bf3b2efb2905 {{(pid=122567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 15 12:44:10.721534 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-c8b307fe-fdf5-4c37-a063-3d63fbc79bad tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635a7f2e64b64ab0be3a8a9270c0cadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff96d81628ad4a9a884766ce86b9c684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:10.729535 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-c8b307fe-fdf5-4c37-a063-3d63fbc79bad tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "GET /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905" status: 200 len: 1304 microversion: 2.1 time: 0.096340 Nov 15 12:44:10.730109 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 362/696] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:44:10 2021] GET /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:44:11.748045 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-dd6f308e-0514-45e7-a534-fe686f28950a tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:11.748740 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-dd6f308e-0514-45e7-a534-fe686f28950a tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 11603efa-1f82-404a-9f04-bf3b2efb2905] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:11.755270 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-dd6f308e-0514-45e7-a534-fe686f28950a tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:11.755786 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-dd6f308e-0514-45e7-a534-fe686f28950a tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:11.756671 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-dd6f308e-0514-45e7-a534-fe686f28950a tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:11.757101 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-dd6f308e-0514-45e7-a534-fe686f28950a tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:11.777217 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.wsgi [None req-dd6f308e-0514-45e7-a534-fe686f28950a tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] HTTP exception thrown: Instance 11603efa-1f82-404a-9f04-bf3b2efb2905 could not be found. Nov 15 12:44:11.781547 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-dd6f308e-0514-45e7-a534-fe686f28950a tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Returning 404 to user: Instance 11603efa-1f82-404a-9f04-bf3b2efb2905 could not be found. {{(pid=122568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:44:11.781547 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-dd6f308e-0514-45e7-a534-fe686f28950a tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "GET /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905" status: 404 len: 111 microversion: 2.1 time: 0.036681 Nov 15 12:44:11.781547 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 335/697] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:44:11 2021] GET /compute/v2.1/servers/11603efa-1f82-404a-9f04-bf3b2efb2905 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 15 12:44:11.834533 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-81610304-4963-49fb-9a1c-de06cfe8eead tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-389778859", "imageRef": "3cc21e2c-27da-4266-be76-369023341c16", "flavorRef": "452", "networks": [{"uuid": "29845f19-cbb4-4be4-8944-6f3102b0a7e4"}]}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:44:11.887000 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.network.neutron [None req-81610304-4963-49fb-9a1c-de06cfe8eead tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] validate_networks() for [('29845f19-cbb4-4be4-8944-6f3102b0a7e4', None, None, None, None, None)] {{(pid=122567) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 15 12:44:12.225185 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-81610304-4963-49fb-9a1c-de06cfe8eead tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Flavor limits 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 15 12:44:12.225610 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-81610304-4963-49fb-9a1c-de06cfe8eead tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Image limits 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 15 12:44:12.226081 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-81610304-4963-49fb-9a1c-de06cfe8eead tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Flavor pref 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 15 12:44:12.226486 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-81610304-4963-49fb-9a1c-de06cfe8eead tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Image pref 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 15 12:44:12.226931 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-81610304-4963-49fb-9a1c-de06cfe8eead tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 15 12:44:12.236237 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-81610304-4963-49fb-9a1c-de06cfe8eead tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:12.236682 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-81610304-4963-49fb-9a1c-de06cfe8eead tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:12.237485 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-81610304-4963-49fb-9a1c-de06cfe8eead tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:12.237922 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-81610304-4963-49fb-9a1c-de06cfe8eead tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:12.254507 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.quota [None req-81610304-4963-49fb-9a1c-de06cfe8eead tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Getting quotas for project ff96d81628ad4a9a884766ce86b9c684. Resources: {'cores', 'ram', 'instances'} {{(pid=122567) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:44:12.258383 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.quota [None req-81610304-4963-49fb-9a1c-de06cfe8eead tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Getting quotas for user 635a7f2e64b64ab0be3a8a9270c0cadb and project ff96d81628ad4a9a884766ce86b9c684. Resources: {'cores', 'ram', 'instances'} {{(pid=122567) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:44:12.269279 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-81610304-4963-49fb-9a1c-de06cfe8eead tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Going to run 1 instances... {{(pid=122567) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 15 12:44:12.271616 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-81610304-4963-49fb-9a1c-de06cfe8eead tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 00b27647-dc65-4977-8538-7f89f95c234b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3cc21e2c-27da-4266-be76-369023341c16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 15 12:44:12.317442 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-81610304-4963-49fb-9a1c-de06cfe8eead tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.487666 Nov 15 12:44:12.318091 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 363/698] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Nov 15 12:44:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 15 12:44:12.327789 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-44e02fba-3dd1-4ba1-800a-c68118f5d41f tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:12.328491 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-44e02fba-3dd1-4ba1-800a-c68118f5d41f tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 00b27647-dc65-4977-8538-7f89f95c234b] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:12.385051 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-44e02fba-3dd1-4ba1-800a-c68118f5d41f tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635a7f2e64b64ab0be3a8a9270c0cadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff96d81628ad4a9a884766ce86b9c684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:12.391551 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-44e02fba-3dd1-4ba1-800a-c68118f5d41f tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "GET /compute/v2.1/servers/00b27647-dc65-4977-8538-7f89f95c234b" status: 200 len: 1213 microversion: 2.1 time: 0.067385 Nov 15 12:44:12.392120 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 336/699] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:44:12 2021] GET /compute/v2.1/servers/00b27647-dc65-4977-8538-7f89f95c234b => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:44:13.409492 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-a77c46cb-0b91-42cb-8f7b-53f869a9c134 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:13.410095 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-a77c46cb-0b91-42cb-8f7b-53f869a9c134 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 00b27647-dc65-4977-8538-7f89f95c234b] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:13.417718 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a77c46cb-0b91-42cb-8f7b-53f869a9c134 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:13.418156 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a77c46cb-0b91-42cb-8f7b-53f869a9c134 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:13.419020 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a77c46cb-0b91-42cb-8f7b-53f869a9c134 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:13.419449 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a77c46cb-0b91-42cb-8f7b-53f869a9c134 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:13.483303 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-a77c46cb-0b91-42cb-8f7b-53f869a9c134 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635a7f2e64b64ab0be3a8a9270c0cadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff96d81628ad4a9a884766ce86b9c684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:13.492635 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-a77c46cb-0b91-42cb-8f7b-53f869a9c134 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "GET /compute/v2.1/servers/00b27647-dc65-4977-8538-7f89f95c234b" status: 200 len: 1273 microversion: 2.1 time: 0.086967 Nov 15 12:44:13.493611 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 364/700] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:44:13 2021] GET /compute/v2.1/servers/00b27647-dc65-4977-8538-7f89f95c234b => generated 1273 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:44:14.509190 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-ab0f1653-21d7-49a8-aa23-a878d300c169 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:14.509791 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-ab0f1653-21d7-49a8-aa23-a878d300c169 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 00b27647-dc65-4977-8538-7f89f95c234b] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:14.516859 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ab0f1653-21d7-49a8-aa23-a878d300c169 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:14.517296 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ab0f1653-21d7-49a8-aa23-a878d300c169 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:14.518064 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ab0f1653-21d7-49a8-aa23-a878d300c169 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:14.518485 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ab0f1653-21d7-49a8-aa23-a878d300c169 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:14.657644 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-ab0f1653-21d7-49a8-aa23-a878d300c169 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635a7f2e64b64ab0be3a8a9270c0cadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff96d81628ad4a9a884766ce86b9c684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:14.664856 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-ab0f1653-21d7-49a8-aa23-a878d300c169 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "GET /compute/v2.1/servers/00b27647-dc65-4977-8538-7f89f95c234b" status: 200 len: 1313 microversion: 2.1 time: 0.159377 Nov 15 12:44:14.665983 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 337/701] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:44:14 2021] GET /compute/v2.1/servers/00b27647-dc65-4977-8538-7f89f95c234b => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:44:15.053727 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [req-4ff20494-f6a2-4858-9fed-feafb62b7067 req-53ab1f4d-003a-4f25-ac78-65ad46dd4a80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00b27647-dc65-4977-8538-7f89f95c234b", "tag": "3a85d893-19b6-4bb1-81b4-1a5d09821052"}]} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:44:15.055433 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:44:15.055433 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: warnings.warn(msg) Nov 15 12:44:15.063311 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-4ff20494-f6a2-4858-9fed-feafb62b7067 req-53ab1f4d-003a-4f25-ac78-65ad46dd4a80 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:15.063869 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-4ff20494-f6a2-4858-9fed-feafb62b7067 req-53ab1f4d-003a-4f25-ac78-65ad46dd4a80 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:15.078363 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.compute.server_external_events [req-4ff20494-f6a2-4858-9fed-feafb62b7067 req-53ab1f4d-003a-4f25-ac78-65ad46dd4a80 service nova] Creating event network-changed:3a85d893-19b6-4bb1-81b4-1a5d09821052 for instance 00b27647-dc65-4977-8538-7f89f95c234b on hv-cinder-68088 Nov 15 12:44:15.083266 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [req-4ff20494-f6a2-4858-9fed-feafb62b7067 req-53ab1f4d-003a-4f25-ac78-65ad46dd4a80 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033174 Nov 15 12:44:15.083863 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 365/702] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:44:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:44:15.683270 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-b5373ff6-4e67-421c-88b5-2734fcfaa9ab tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:15.683869 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-b5373ff6-4e67-421c-88b5-2734fcfaa9ab tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 00b27647-dc65-4977-8538-7f89f95c234b] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:15.690528 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b5373ff6-4e67-421c-88b5-2734fcfaa9ab tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:15.691008 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b5373ff6-4e67-421c-88b5-2734fcfaa9ab tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:15.691770 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b5373ff6-4e67-421c-88b5-2734fcfaa9ab tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:15.692194 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b5373ff6-4e67-421c-88b5-2734fcfaa9ab tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:15.823089 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-b5373ff6-4e67-421c-88b5-2734fcfaa9ab tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635a7f2e64b64ab0be3a8a9270c0cadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff96d81628ad4a9a884766ce86b9c684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:15.830450 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-b5373ff6-4e67-421c-88b5-2734fcfaa9ab tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "GET /compute/v2.1/servers/00b27647-dc65-4977-8538-7f89f95c234b" status: 200 len: 1313 microversion: 2.1 time: 0.151407 Nov 15 12:44:15.831052 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 338/703] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:44:15 2021] GET /compute/v2.1/servers/00b27647-dc65-4977-8538-7f89f95c234b => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:44:16.849047 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-d0cdff70-fd93-4aaf-8188-7a84345444a9 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:16.849663 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-d0cdff70-fd93-4aaf-8188-7a84345444a9 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 00b27647-dc65-4977-8538-7f89f95c234b] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:16.857012 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d0cdff70-fd93-4aaf-8188-7a84345444a9 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:16.857458 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d0cdff70-fd93-4aaf-8188-7a84345444a9 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:16.858232 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d0cdff70-fd93-4aaf-8188-7a84345444a9 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:16.858666 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d0cdff70-fd93-4aaf-8188-7a84345444a9 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:16.997515 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-d0cdff70-fd93-4aaf-8188-7a84345444a9 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635a7f2e64b64ab0be3a8a9270c0cadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff96d81628ad4a9a884766ce86b9c684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:17.004806 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-d0cdff70-fd93-4aaf-8188-7a84345444a9 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "GET /compute/v2.1/servers/00b27647-dc65-4977-8538-7f89f95c234b" status: 200 len: 1313 microversion: 2.1 time: 0.159934 Nov 15 12:44:17.005372 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 366/704] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:44:16 2021] GET /compute/v2.1/servers/00b27647-dc65-4977-8538-7f89f95c234b => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:44:18.021902 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-e8652cf4-ec43-4bc4-88de-c8889a4a96cd tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:18.022615 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-e8652cf4-ec43-4bc4-88de-c8889a4a96cd tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 00b27647-dc65-4977-8538-7f89f95c234b] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:18.029434 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e8652cf4-ec43-4bc4-88de-c8889a4a96cd tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:18.029886 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e8652cf4-ec43-4bc4-88de-c8889a4a96cd tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:18.030663 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e8652cf4-ec43-4bc4-88de-c8889a4a96cd tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:18.031120 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e8652cf4-ec43-4bc4-88de-c8889a4a96cd tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:18.166818 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-e8652cf4-ec43-4bc4-88de-c8889a4a96cd tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635a7f2e64b64ab0be3a8a9270c0cadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff96d81628ad4a9a884766ce86b9c684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:18.174230 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-e8652cf4-ec43-4bc4-88de-c8889a4a96cd tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "GET /compute/v2.1/servers/00b27647-dc65-4977-8538-7f89f95c234b" status: 200 len: 1313 microversion: 2.1 time: 0.156073 Nov 15 12:44:18.174813 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 339/705] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:44:18 2021] GET /compute/v2.1/servers/00b27647-dc65-4977-8538-7f89f95c234b => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:44:19.190497 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-3a0cef64-961e-4f1f-846a-8c9230ccee63 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:19.191132 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-3a0cef64-961e-4f1f-846a-8c9230ccee63 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 00b27647-dc65-4977-8538-7f89f95c234b] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:19.198308 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3a0cef64-961e-4f1f-846a-8c9230ccee63 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:19.198758 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3a0cef64-961e-4f1f-846a-8c9230ccee63 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:19.199600 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3a0cef64-961e-4f1f-846a-8c9230ccee63 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:19.200034 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3a0cef64-961e-4f1f-846a-8c9230ccee63 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:19.335586 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-3a0cef64-961e-4f1f-846a-8c9230ccee63 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635a7f2e64b64ab0be3a8a9270c0cadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff96d81628ad4a9a884766ce86b9c684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:19.344516 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-3a0cef64-961e-4f1f-846a-8c9230ccee63 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "GET /compute/v2.1/servers/00b27647-dc65-4977-8538-7f89f95c234b" status: 200 len: 1313 microversion: 2.1 time: 0.157726 Nov 15 12:44:19.345109 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 367/706] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:44:19 2021] GET /compute/v2.1/servers/00b27647-dc65-4977-8538-7f89f95c234b => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:44:20.363577 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-163bb732-7673-4907-b2d2-a936472aa4e2 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:20.364783 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-163bb732-7673-4907-b2d2-a936472aa4e2 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 00b27647-dc65-4977-8538-7f89f95c234b] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:20.371996 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-163bb732-7673-4907-b2d2-a936472aa4e2 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:20.372650 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-163bb732-7673-4907-b2d2-a936472aa4e2 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:20.373233 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-163bb732-7673-4907-b2d2-a936472aa4e2 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:20.373666 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-163bb732-7673-4907-b2d2-a936472aa4e2 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:20.507056 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-163bb732-7673-4907-b2d2-a936472aa4e2 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635a7f2e64b64ab0be3a8a9270c0cadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff96d81628ad4a9a884766ce86b9c684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:20.515029 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-163bb732-7673-4907-b2d2-a936472aa4e2 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "GET /compute/v2.1/servers/00b27647-dc65-4977-8538-7f89f95c234b" status: 200 len: 1313 microversion: 2.1 time: 0.155007 Nov 15 12:44:20.515621 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 340/707] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:44:20 2021] GET /compute/v2.1/servers/00b27647-dc65-4977-8538-7f89f95c234b => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:44:21.532921 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-656742dc-3d40-42fc-a101-688dcbbbd8a8 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:21.533563 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-656742dc-3d40-42fc-a101-688dcbbbd8a8 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 00b27647-dc65-4977-8538-7f89f95c234b] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:21.540039 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-656742dc-3d40-42fc-a101-688dcbbbd8a8 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:21.540481 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-656742dc-3d40-42fc-a101-688dcbbbd8a8 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:21.541256 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-656742dc-3d40-42fc-a101-688dcbbbd8a8 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:21.542331 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-656742dc-3d40-42fc-a101-688dcbbbd8a8 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:21.674741 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-656742dc-3d40-42fc-a101-688dcbbbd8a8 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635a7f2e64b64ab0be3a8a9270c0cadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff96d81628ad4a9a884766ce86b9c684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:21.681964 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-656742dc-3d40-42fc-a101-688dcbbbd8a8 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "GET /compute/v2.1/servers/00b27647-dc65-4977-8538-7f89f95c234b" status: 200 len: 1313 microversion: 2.1 time: 0.152735 Nov 15 12:44:21.682539 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 368/708] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:44:21 2021] GET /compute/v2.1/servers/00b27647-dc65-4977-8538-7f89f95c234b => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:44:22.540094 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-3c1003bc-c774-4879-9844-71598346189f req-602a39e7-dc88-417d-ab81-3e528a630980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00b27647-dc65-4977-8538-7f89f95c234b", "name": "network-vif-plugged", "status": "completed", "tag": "3a85d893-19b6-4bb1-81b4-1a5d09821052"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:44:22.541621 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:44:22.541621 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:44:22.551470 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-3c1003bc-c774-4879-9844-71598346189f req-602a39e7-dc88-417d-ab81-3e528a630980 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:22.551925 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-3c1003bc-c774-4879-9844-71598346189f req-602a39e7-dc88-417d-ab81-3e528a630980 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:22.563781 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-3c1003bc-c774-4879-9844-71598346189f req-602a39e7-dc88-417d-ab81-3e528a630980 service nova] Creating event network-vif-plugged:3a85d893-19b6-4bb1-81b4-1a5d09821052 for instance 00b27647-dc65-4977-8538-7f89f95c234b on hv-cinder-68088 Nov 15 12:44:22.568824 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-3c1003bc-c774-4879-9844-71598346189f req-602a39e7-dc88-417d-ab81-3e528a630980 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032318 Nov 15 12:44:22.569419 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 341/709] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:44:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:44:22.699253 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-c2234a84-9157-4de8-a1ba-09903a7b8a45 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:22.700238 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-c2234a84-9157-4de8-a1ba-09903a7b8a45 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 00b27647-dc65-4977-8538-7f89f95c234b] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:22.707031 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c2234a84-9157-4de8-a1ba-09903a7b8a45 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:22.707482 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c2234a84-9157-4de8-a1ba-09903a7b8a45 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:22.708272 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c2234a84-9157-4de8-a1ba-09903a7b8a45 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:22.708705 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c2234a84-9157-4de8-a1ba-09903a7b8a45 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:22.847659 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-c2234a84-9157-4de8-a1ba-09903a7b8a45 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635a7f2e64b64ab0be3a8a9270c0cadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff96d81628ad4a9a884766ce86b9c684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:22.855535 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-c2234a84-9157-4de8-a1ba-09903a7b8a45 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "GET /compute/v2.1/servers/00b27647-dc65-4977-8538-7f89f95c234b" status: 200 len: 1313 microversion: 2.1 time: 0.159851 Nov 15 12:44:22.856115 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 369/710] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:44:22 2021] GET /compute/v2.1/servers/00b27647-dc65-4977-8538-7f89f95c234b => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:44:23.873855 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-f78842d2-6d64-43c3-9021-4f0b17872026 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:23.874544 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-f78842d2-6d64-43c3-9021-4f0b17872026 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 00b27647-dc65-4977-8538-7f89f95c234b] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:23.881283 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f78842d2-6d64-43c3-9021-4f0b17872026 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:23.881739 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f78842d2-6d64-43c3-9021-4f0b17872026 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:23.882525 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f78842d2-6d64-43c3-9021-4f0b17872026 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:23.882976 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f78842d2-6d64-43c3-9021-4f0b17872026 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:24.016407 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-f78842d2-6d64-43c3-9021-4f0b17872026 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635a7f2e64b64ab0be3a8a9270c0cadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff96d81628ad4a9a884766ce86b9c684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:24.023636 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-f78842d2-6d64-43c3-9021-4f0b17872026 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "GET /compute/v2.1/servers/00b27647-dc65-4977-8538-7f89f95c234b" status: 200 len: 1313 microversion: 2.1 time: 0.154871 Nov 15 12:44:24.024205 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 342/711] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:44:23 2021] GET /compute/v2.1/servers/00b27647-dc65-4977-8538-7f89f95c234b => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:44:25.045186 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-d8c77aa4-b78a-4ef8-bb96-dd94cd2b9e5b tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:25.045792 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-d8c77aa4-b78a-4ef8-bb96-dd94cd2b9e5b tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 00b27647-dc65-4977-8538-7f89f95c234b] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:25.052921 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d8c77aa4-b78a-4ef8-bb96-dd94cd2b9e5b tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:25.053384 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d8c77aa4-b78a-4ef8-bb96-dd94cd2b9e5b tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:25.054172 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d8c77aa4-b78a-4ef8-bb96-dd94cd2b9e5b tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:25.054615 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d8c77aa4-b78a-4ef8-bb96-dd94cd2b9e5b tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:25.185790 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-d8c77aa4-b78a-4ef8-bb96-dd94cd2b9e5b tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635a7f2e64b64ab0be3a8a9270c0cadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff96d81628ad4a9a884766ce86b9c684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:25.193073 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-d8c77aa4-b78a-4ef8-bb96-dd94cd2b9e5b tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "GET /compute/v2.1/servers/00b27647-dc65-4977-8538-7f89f95c234b" status: 200 len: 1497 microversion: 2.1 time: 0.152321 Nov 15 12:44:25.193643 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 370/712] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:44:25 2021] GET /compute/v2.1/servers/00b27647-dc65-4977-8538-7f89f95c234b => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:44:25.804968 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-fa0b49d8-7066-4a8b-bba9-fe7c3f9d4a3f tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:25.805488 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-fa0b49d8-7066-4a8b-bba9-fe7c3f9d4a3f tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 00b27647-dc65-4977-8538-7f89f95c234b] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:25.812229 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fa0b49d8-7066-4a8b-bba9-fe7c3f9d4a3f tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:25.812670 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fa0b49d8-7066-4a8b-bba9-fe7c3f9d4a3f tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:25.813444 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fa0b49d8-7066-4a8b-bba9-fe7c3f9d4a3f tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:25.813870 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fa0b49d8-7066-4a8b-bba9-fe7c3f9d4a3f tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:25.838439 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-fa0b49d8-7066-4a8b-bba9-fe7c3f9d4a3f tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 00b27647-dc65-4977-8538-7f89f95c234b] Going to try to terminate instance {{(pid=122568) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 15 12:44:25.918149 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-fa0b49d8-7066-4a8b-bba9-fe7c3f9d4a3f tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "DELETE /compute/v2.1/servers/00b27647-dc65-4977-8538-7f89f95c234b" status: 204 len: 0 microversion: 2.1 time: 0.116340 Nov 15 12:44:25.919117 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 343/713] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Nov 15 12:44:25 2021] DELETE /compute/v2.1/servers/00b27647-dc65-4977-8538-7f89f95c234b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 15 12:44:25.927457 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-bbcf14aa-1ccf-411e-bb6f-20a247c4732f tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:25.928120 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-bbcf14aa-1ccf-411e-bb6f-20a247c4732f tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 00b27647-dc65-4977-8538-7f89f95c234b] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:25.935503 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bbcf14aa-1ccf-411e-bb6f-20a247c4732f tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:25.935942 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bbcf14aa-1ccf-411e-bb6f-20a247c4732f tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:25.936713 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bbcf14aa-1ccf-411e-bb6f-20a247c4732f tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:25.937462 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bbcf14aa-1ccf-411e-bb6f-20a247c4732f tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:26.069987 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-bbcf14aa-1ccf-411e-bb6f-20a247c4732f tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635a7f2e64b64ab0be3a8a9270c0cadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff96d81628ad4a9a884766ce86b9c684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:26.078097 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-bbcf14aa-1ccf-411e-bb6f-20a247c4732f tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "GET /compute/v2.1/servers/00b27647-dc65-4977-8538-7f89f95c234b" status: 200 len: 1503 microversion: 2.1 time: 0.154432 Nov 15 12:44:26.078729 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 371/714] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:44:25 2021] GET /compute/v2.1/servers/00b27647-dc65-4977-8538-7f89f95c234b => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:44:27.096632 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-9f93267e-69a1-445d-8da2-0284a5699c52 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:27.097324 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-9f93267e-69a1-445d-8da2-0284a5699c52 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 00b27647-dc65-4977-8538-7f89f95c234b] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:27.103602 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9f93267e-69a1-445d-8da2-0284a5699c52 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:27.104047 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9f93267e-69a1-445d-8da2-0284a5699c52 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:27.105341 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9f93267e-69a1-445d-8da2-0284a5699c52 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:27.106365 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9f93267e-69a1-445d-8da2-0284a5699c52 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:27.239985 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-9f93267e-69a1-445d-8da2-0284a5699c52 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635a7f2e64b64ab0be3a8a9270c0cadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff96d81628ad4a9a884766ce86b9c684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:27.247936 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-9f93267e-69a1-445d-8da2-0284a5699c52 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "GET /compute/v2.1/servers/00b27647-dc65-4977-8538-7f89f95c234b" status: 200 len: 1503 microversion: 2.1 time: 0.155663 Nov 15 12:44:27.248502 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 344/715] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:44:27 2021] GET /compute/v2.1/servers/00b27647-dc65-4977-8538-7f89f95c234b => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:44:28.266514 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-c4227e5f-bff0-4810-a6b3-e001da24163e tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:28.267113 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-c4227e5f-bff0-4810-a6b3-e001da24163e tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 00b27647-dc65-4977-8538-7f89f95c234b] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:28.274120 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c4227e5f-bff0-4810-a6b3-e001da24163e tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:28.274581 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c4227e5f-bff0-4810-a6b3-e001da24163e tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:28.275471 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c4227e5f-bff0-4810-a6b3-e001da24163e tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:28.275906 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c4227e5f-bff0-4810-a6b3-e001da24163e tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:28.348064 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-c4227e5f-bff0-4810-a6b3-e001da24163e tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635a7f2e64b64ab0be3a8a9270c0cadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff96d81628ad4a9a884766ce86b9c684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:28.356112 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-c4227e5f-bff0-4810-a6b3-e001da24163e tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "GET /compute/v2.1/servers/00b27647-dc65-4977-8538-7f89f95c234b" status: 200 len: 1461 microversion: 2.1 time: 0.095056 Nov 15 12:44:28.356956 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 372/716] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:44:28 2021] GET /compute/v2.1/servers/00b27647-dc65-4977-8538-7f89f95c234b => generated 1461 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:44:28.396520 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-9ecd036a-44cb-4f80-a07a-d445f7b42411 req-32d4e915-a7ea-4a62-806e-93838e6ed1ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00b27647-dc65-4977-8538-7f89f95c234b", "name": "network-vif-deleted", "tag": "3a85d893-19b6-4bb1-81b4-1a5d09821052"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:44:28.399622 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:44:28.399622 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:44:28.408712 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-9ecd036a-44cb-4f80-a07a-d445f7b42411 req-32d4e915-a7ea-4a62-806e-93838e6ed1ca service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:28.409151 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-9ecd036a-44cb-4f80-a07a-d445f7b42411 req-32d4e915-a7ea-4a62-806e-93838e6ed1ca service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:28.421936 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-9ecd036a-44cb-4f80-a07a-d445f7b42411 req-32d4e915-a7ea-4a62-806e-93838e6ed1ca service nova] Creating event network-vif-deleted:3a85d893-19b6-4bb1-81b4-1a5d09821052 for instance 00b27647-dc65-4977-8538-7f89f95c234b on hv-cinder-68088 Nov 15 12:44:28.428076 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-9ecd036a-44cb-4f80-a07a-d445f7b42411 req-32d4e915-a7ea-4a62-806e-93838e6ed1ca service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036088 Nov 15 12:44:28.429284 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 345/717] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:44:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 15 12:44:29.378840 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-77e804d0-6f85-45f9-b046-820f7432d5c3 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:29.379653 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-77e804d0-6f85-45f9-b046-820f7432d5c3 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] [instance: 00b27647-dc65-4977-8538-7f89f95c234b] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:29.388225 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-77e804d0-6f85-45f9-b046-820f7432d5c3 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:29.388667 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-77e804d0-6f85-45f9-b046-820f7432d5c3 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:29.389456 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-77e804d0-6f85-45f9-b046-820f7432d5c3 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:29.389885 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-77e804d0-6f85-45f9-b046-820f7432d5c3 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:29.406701 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.wsgi [None req-77e804d0-6f85-45f9-b046-820f7432d5c3 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] HTTP exception thrown: Instance 00b27647-dc65-4977-8538-7f89f95c234b could not be found. Nov 15 12:44:29.407390 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-77e804d0-6f85-45f9-b046-820f7432d5c3 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] Returning 404 to user: Instance 00b27647-dc65-4977-8538-7f89f95c234b could not be found. {{(pid=122567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:44:29.408154 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-77e804d0-6f85-45f9-b046-820f7432d5c3 tempest-VolumesActionsTest-545072301 tempest-VolumesActionsTest-545072301-project] 10.222.0.43 "GET /compute/v2.1/servers/00b27647-dc65-4977-8538-7f89f95c234b" status: 404 len: 111 microversion: 2.1 time: 0.033001 Nov 15 12:44:29.408740 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 373/718] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:44:29 2021] GET /compute/v2.1/servers/00b27647-dc65-4977-8538-7f89f95c234b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 15 12:44:39.304941 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-2811cd43-c1c4-4572-bc37-4835b964a554 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:39.305940 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-2811cd43-c1c4-4572-bc37-4835b964a554 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:39.327656 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2811cd43-c1c4-4572-bc37-4835b964a554 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:39.328172 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2811cd43-c1c4-4572-bc37-4835b964a554 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:39.329241 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2811cd43-c1c4-4572-bc37-4835b964a554 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:39.329825 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2811cd43-c1c4-4572-bc37-4835b964a554 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:39.430032 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-2811cd43-c1c4-4572-bc37-4835b964a554 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.128808 Nov 15 12:44:39.431526 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 346/719] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Nov 15 12:44:39 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d/os-volume_attachments => generated 25 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 15 12:44:39.576589 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-01e19fe5-4710-4e12-b777-62c41430e917 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:39.577887 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-01e19fe5-4710-4e12-b777-62c41430e917 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:39.594197 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-01e19fe5-4710-4e12-b777-62c41430e917 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:39.595850 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-01e19fe5-4710-4e12-b777-62c41430e917 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:39.598829 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-01e19fe5-4710-4e12-b777-62c41430e917 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:39.601268 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-01e19fe5-4710-4e12-b777-62c41430e917 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:39.655543 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-01e19fe5-4710-4e12-b777-62c41430e917 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Going to try to terminate instance {{(pid=122567) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 15 12:44:39.757441 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-bf9acf32-0098-41e0-bb16-14a32a4426e1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:39.757848 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-bf9acf32-0098-41e0-bb16-14a32a4426e1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:39.768470 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bf9acf32-0098-41e0-bb16-14a32a4426e1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:39.769223 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bf9acf32-0098-41e0-bb16-14a32a4426e1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:39.770337 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bf9acf32-0098-41e0-bb16-14a32a4426e1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:39.771098 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bf9acf32-0098-41e0-bb16-14a32a4426e1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:39.853338 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-bf9acf32-0098-41e0-bb16-14a32a4426e1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/os-volume_attachments/9dc2606b-2e79-4ecd-a1f6-1cb1c57a75b8" status: 200 len: 194 microversion: 2.20 time: 0.099999 Nov 15 12:44:39.860516 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 347/720] 10.222.0.43 () {60 vars in 1453 bytes} [Mon Nov 15 12:44:39 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/os-volume_attachments/9dc2606b-2e79-4ecd-a1f6-1cb1c57a75b8 => generated 194 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:44:39.907456 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-01e19fe5-4710-4e12-b777-62c41430e917 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 204 len: 0 microversion: 2.1 time: 0.334237 Nov 15 12:44:39.908452 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 374/721] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Nov 15 12:44:39 2021] DELETE /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 15 12:44:39.917750 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-f40a7319-4cdf-4d3f-bd31-e996f193514a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:39.918757 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-f40a7319-4cdf-4d3f-bd31-e996f193514a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:39.929830 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f40a7319-4cdf-4d3f-bd31-e996f193514a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:39.930658 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f40a7319-4cdf-4d3f-bd31-e996f193514a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:39.932196 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f40a7319-4cdf-4d3f-bd31-e996f193514a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:39.933579 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f40a7319-4cdf-4d3f-bd31-e996f193514a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:40.025745 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-a8abfe1d-38da-4b96-9483-3942fe7c3c53 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:40.027224 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-a8abfe1d-38da-4b96-9483-3942fe7c3c53 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:40.048481 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a8abfe1d-38da-4b96-9483-3942fe7c3c53 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:40.048935 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a8abfe1d-38da-4b96-9483-3942fe7c3c53 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:40.049748 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a8abfe1d-38da-4b96-9483-3942fe7c3c53 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:40.050209 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a8abfe1d-38da-4b96-9483-3942fe7c3c53 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:40.539879 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.objects.instance [None req-a8abfe1d-38da-4b96-9483-3942fe7c3c53 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lazy-loading 'services' on Instance uuid 11daa0bc-1e25-47d7-a6df-ffc808e1ff58 {{(pid=122567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 15 12:44:40.650754 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-a8abfe1d-38da-4b96-9483-3942fe7c3c53 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "DELETE /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/os-volume_attachments/9dc2606b-2e79-4ecd-a1f6-1cb1c57a75b8" status: 202 len: 0 microversion: 2.20 time: 0.630830 Nov 15 12:44:40.652932 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 375/722] 10.222.0.43 () {60 vars in 1456 bytes} [Mon Nov 15 12:44:40 2021] DELETE /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/os-volume_attachments/9dc2606b-2e79-4ecd-a1f6-1cb1c57a75b8 => generated 0 bytes in 635 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 15 12:44:40.665130 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-26739623-f428-464d-b600-17857c5a3fe0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:40.666989 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-26739623-f428-464d-b600-17857c5a3fe0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:40.679233 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-26739623-f428-464d-b600-17857c5a3fe0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:40.679827 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-26739623-f428-464d-b600-17857c5a3fe0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:40.682309 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-26739623-f428-464d-b600-17857c5a3fe0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:40.684158 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-26739623-f428-464d-b600-17857c5a3fe0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:40.743373 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-26739623-f428-464d-b600-17857c5a3fe0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.084403 Nov 15 12:44:40.750042 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 376/723] 10.222.0.43 () {60 vars in 1342 bytes} [Mon Nov 15 12:44:40 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:44:41.078816 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-f40a7319-4cdf-4d3f-bd31-e996f193514a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:41.094342 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-f40a7319-4cdf-4d3f-bd31-e996f193514a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1673 microversion: 2.1 time: 1.177747 Nov 15 12:44:41.095801 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 348/724] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:44:39 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1673 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:44:41.200089 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-f1854854-012f-4802-ab3d-a5a29089f107 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Action: 'create', calling method: .version_select at 0x7f1320552e50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1935274887"}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:44:41.257843 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.quota [None req-f1854854-012f-4802-ab3d-a5a29089f107 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Getting quotas for project f78fedf356a24ea182428c85682330f1. Resources: {'key_pairs'} {{(pid=122567) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:44:41.265150 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.quota [None req-f1854854-012f-4802-ab3d-a5a29089f107 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Getting quotas for user 84c8f2a4f7c84026859778c12d6f7c35 and project f78fedf356a24ea182428c85682330f1. Resources: {'key_pairs'} {{(pid=122567) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:44:41.614953 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.quota [None req-f1854854-012f-4802-ab3d-a5a29089f107 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Getting quotas for project f78fedf356a24ea182428c85682330f1. Resources: {'key_pairs'} {{(pid=122567) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:44:41.619704 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.quota [None req-f1854854-012f-4802-ab3d-a5a29089f107 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Getting quotas for user 84c8f2a4f7c84026859778c12d6f7c35 and project f78fedf356a24ea182428c85682330f1. Resources: {'key_pairs'} {{(pid=122567) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:44:41.658235 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-f1854854-012f-4802-ab3d-a5a29089f107 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.621730 Nov 15 12:44:41.674566 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 377/725] 10.222.0.43 () {60 vars in 1157 bytes} [Mon Nov 15 12:44:41 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:44:41.756801 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-fcfbd991-2014-4502-b32b-1adccfc2c44b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:41.757850 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-fcfbd991-2014-4502-b32b-1adccfc2c44b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:41.768322 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fcfbd991-2014-4502-b32b-1adccfc2c44b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:41.769244 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fcfbd991-2014-4502-b32b-1adccfc2c44b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:41.770532 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fcfbd991-2014-4502-b32b-1adccfc2c44b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:41.771237 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fcfbd991-2014-4502-b32b-1adccfc2c44b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:41.811869 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-fcfbd991-2014-4502-b32b-1adccfc2c44b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057962 Nov 15 12:44:41.815141 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 349/726] 10.222.0.43 () {60 vars in 1342 bytes} [Mon Nov 15 12:44:41 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:44:41.924431 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-8e79c205-aa40-4655-b75e-f85885e87494 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:41.925545 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-8e79c205-aa40-4655-b75e-f85885e87494 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:41.936929 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8e79c205-aa40-4655-b75e-f85885e87494 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:41.937641 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8e79c205-aa40-4655-b75e-f85885e87494 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:41.938599 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8e79c205-aa40-4655-b75e-f85885e87494 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:41.940332 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8e79c205-aa40-4655-b75e-f85885e87494 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:41.998177 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-8e79c205-aa40-4655-b75e-f85885e87494 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Going to try to terminate instance {{(pid=122567) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 15 12:44:42.113472 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-188c85be-8aa0-4c0f-a619-d46395de87ff tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:42.114237 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-188c85be-8aa0-4c0f-a619-d46395de87ff tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:42.131425 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-188c85be-8aa0-4c0f-a619-d46395de87ff tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:42.133497 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-188c85be-8aa0-4c0f-a619-d46395de87ff tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:42.134460 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-188c85be-8aa0-4c0f-a619-d46395de87ff tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:42.137943 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-188c85be-8aa0-4c0f-a619-d46395de87ff tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:42.181156 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-8e79c205-aa40-4655-b75e-f85885e87494 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "DELETE /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 204 len: 0 microversion: 2.20 time: 0.263034 Nov 15 12:44:42.183367 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 378/727] 10.222.0.43 () {60 vars in 1279 bytes} [Mon Nov 15 12:44:41 2021] DELETE /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 15 12:44:42.201621 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e31a993d-543d-41af-8633-cfee50254493 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:42.203120 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e31a993d-543d-41af-8633-cfee50254493 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:42.213828 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e31a993d-543d-41af-8633-cfee50254493 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:42.215402 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e31a993d-543d-41af-8633-cfee50254493 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:42.216906 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e31a993d-543d-41af-8633-cfee50254493 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:42.217923 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e31a993d-543d-41af-8633-cfee50254493 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:42.726172 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e31a993d-543d-41af-8633-cfee50254493 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:42.739201 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e31a993d-543d-41af-8633-cfee50254493 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:42.743263 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e31a993d-543d-41af-8633-cfee50254493 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:42.745897 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e31a993d-543d-41af-8633-cfee50254493 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1725 microversion: 2.20 time: 0.553109 Nov 15 12:44:42.747450 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 379/728] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:44:42 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1725 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:44:42.769440 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-188c85be-8aa0-4c0f-a619-d46395de87ff tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:42.790488 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-188c85be-8aa0-4c0f-a619-d46395de87ff tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1673 microversion: 2.1 time: 0.680892 Nov 15 12:44:42.791391 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 350/729] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:44:42 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1673 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:44:43.766378 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-616a4299-3c0a-414f-98e6-40493497a6eb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:43.767949 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-616a4299-3c0a-414f-98e6-40493497a6eb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:43.784248 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-616a4299-3c0a-414f-98e6-40493497a6eb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:43.784248 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-616a4299-3c0a-414f-98e6-40493497a6eb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:43.785842 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-616a4299-3c0a-414f-98e6-40493497a6eb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:43.786557 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-616a4299-3c0a-414f-98e6-40493497a6eb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:43.809652 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-1ecab858-6537-4c58-a7af-e5beccdcce55 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:43.811025 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-1ecab858-6537-4c58-a7af-e5beccdcce55 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:43.822711 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1ecab858-6537-4c58-a7af-e5beccdcce55 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:43.826932 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1ecab858-6537-4c58-a7af-e5beccdcce55 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:43.828052 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1ecab858-6537-4c58-a7af-e5beccdcce55 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:43.828657 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1ecab858-6537-4c58-a7af-e5beccdcce55 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:44.013720 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-1ecab858-6537-4c58-a7af-e5beccdcce55 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:44.022291 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-1ecab858-6537-4c58-a7af-e5beccdcce55 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 200 len: 1605 microversion: 2.1 time: 0.217417 Nov 15 12:44:44.028856 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 351/730] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:44:43 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 1605 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:44:44.112420 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-feb9886b-5226-40ca-a837-c6cf6d75f4a3 req-e4358319-40ec-4bb7-9eac-f4c35e62604f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a107064a-524f-4964-97da-84d2b50d422d", "name": "network-vif-deleted", "tag": "bb0f4a9a-c9a8-4d3c-b1a8-f21dae3f8b8a"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:44:44.114531 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:44:44.114531 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:44:44.122606 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-feb9886b-5226-40ca-a837-c6cf6d75f4a3 req-e4358319-40ec-4bb7-9eac-f4c35e62604f service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:44.123072 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-feb9886b-5226-40ca-a837-c6cf6d75f4a3 req-e4358319-40ec-4bb7-9eac-f4c35e62604f service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:44.148629 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-feb9886b-5226-40ca-a837-c6cf6d75f4a3 req-e4358319-40ec-4bb7-9eac-f4c35e62604f service nova] Creating event network-vif-deleted:bb0f4a9a-c9a8-4d3c-b1a8-f21dae3f8b8a for instance a107064a-524f-4964-97da-84d2b50d422d on hv-cinder-68088 Nov 15 12:44:44.170911 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-feb9886b-5226-40ca-a837-c6cf6d75f4a3 req-e4358319-40ec-4bb7-9eac-f4c35e62604f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062107 Nov 15 12:44:44.172377 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 352/731] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:44:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 15 12:44:44.275081 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-616a4299-3c0a-414f-98e6-40493497a6eb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:44.298247 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-616a4299-3c0a-414f-98e6-40493497a6eb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:44.304440 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-616a4299-3c0a-414f-98e6-40493497a6eb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:44.305671 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-616a4299-3c0a-414f-98e6-40493497a6eb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1725 microversion: 2.20 time: 0.543148 Nov 15 12:44:44.310953 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 380/732] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:44:43 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1725 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:44:45.047464 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-cb8583e3-5afd-4d70-9413-22e0a0ef1853 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:45.050337 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-cb8583e3-5afd-4d70-9413-22e0a0ef1853 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:45.068506 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-cb8583e3-5afd-4d70-9413-22e0a0ef1853 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:45.068948 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-cb8583e3-5afd-4d70-9413-22e0a0ef1853 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:45.069726 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-cb8583e3-5afd-4d70-9413-22e0a0ef1853 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:45.075924 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-cb8583e3-5afd-4d70-9413-22e0a0ef1853 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:45.108120 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.wsgi [None req-cb8583e3-5afd-4d70-9413-22e0a0ef1853 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] HTTP exception thrown: Instance a107064a-524f-4964-97da-84d2b50d422d could not be found. Nov 15 12:44:45.109134 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-cb8583e3-5afd-4d70-9413-22e0a0ef1853 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Returning 404 to user: Instance a107064a-524f-4964-97da-84d2b50d422d could not be found. {{(pid=122568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:44:45.111658 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-cb8583e3-5afd-4d70-9413-22e0a0ef1853 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 404 len: 111 microversion: 2.1 time: 0.074581 Nov 15 12:44:45.112476 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 353/733] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:44:45 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 15 12:44:45.121958 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-549fc1dc-cbd5-479f-a409-fc3a6147ecdd tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '.version_select at 0x7f13202e5af0>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:45.163923 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-549fc1dc-cbd5-479f-a409-fc3a6147ecdd tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-954062943" status: 202 len: 0 microversion: 2.1 time: 0.046459 Nov 15 12:44:45.166174 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 381/734] 10.222.0.43 () {58 vars in 1217 bytes} [Mon Nov 15 12:44:45 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-954062943 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:44:45.329319 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-5713b9aa-fe73-4946-ac9c-a04fc2d80e34 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:45.329927 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-5713b9aa-fe73-4946-ac9c-a04fc2d80e34 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:45.357046 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5713b9aa-fe73-4946-ac9c-a04fc2d80e34 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:45.358285 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5713b9aa-fe73-4946-ac9c-a04fc2d80e34 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:45.360924 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5713b9aa-fe73-4946-ac9c-a04fc2d80e34 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:45.366746 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5713b9aa-fe73-4946-ac9c-a04fc2d80e34 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:46.072438 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-5713b9aa-fe73-4946-ac9c-a04fc2d80e34 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:46.082090 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-5713b9aa-fe73-4946-ac9c-a04fc2d80e34 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:46.083647 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-5713b9aa-fe73-4946-ac9c-a04fc2d80e34 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:46.091914 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-5713b9aa-fe73-4946-ac9c-a04fc2d80e34 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1725 microversion: 2.20 time: 0.766539 Nov 15 12:44:46.094106 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 354/735] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:44:45 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1725 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:44:46.475315 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [req-649ada56-845b-4750-b0bb-3eefa5ee53f4 req-c3d3d5ca-c569-4014-8b70-03a5a068ce0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11daa0bc-1e25-47d7-a6df-ffc808e1ff58", "name": "network-vif-deleted", "tag": "7a90a770-a011-4cb6-9fcf-893773b8d120"}]} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:44:46.479844 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:44:46.479844 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: warnings.warn(msg) Nov 15 12:44:46.518719 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-649ada56-845b-4750-b0bb-3eefa5ee53f4 req-c3d3d5ca-c569-4014-8b70-03a5a068ce0e service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:46.521051 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-649ada56-845b-4750-b0bb-3eefa5ee53f4 req-c3d3d5ca-c569-4014-8b70-03a5a068ce0e service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:46.577582 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.compute.server_external_events [req-649ada56-845b-4750-b0bb-3eefa5ee53f4 req-c3d3d5ca-c569-4014-8b70-03a5a068ce0e service nova] Creating event network-vif-deleted:7a90a770-a011-4cb6-9fcf-893773b8d120 for instance 11daa0bc-1e25-47d7-a6df-ffc808e1ff58 on hv-cinder-68088 Nov 15 12:44:46.588835 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [req-649ada56-845b-4750-b0bb-3eefa5ee53f4 req-c3d3d5ca-c569-4014-8b70-03a5a068ce0e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121383 Nov 15 12:44:46.595953 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 382/736] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:44:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 15 12:44:46.867680 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-62abe3c1-73fc-4f3f-8b16-c4363ab2eec1 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'create', calling method: .version_select at 0x7f131b30a310>, body: {"keypair": {"name": "tempest-keypair-1588588195"}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:44:46.902252 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-62abe3c1-73fc-4f3f-8b16-c4363ab2eec1 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Getting quotas for project b91bd39e4f3b40f396370b06f870aeb6. Resources: {'key_pairs'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:44:46.908214 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-62abe3c1-73fc-4f3f-8b16-c4363ab2eec1 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Getting quotas for user 1f4fb2fdbe754d13af2222261fddbbdc and project b91bd39e4f3b40f396370b06f870aeb6. Resources: {'key_pairs'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:44:47.113557 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-db539722-7911-4b8b-b688-a8f96529606e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:47.114254 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-db539722-7911-4b8b-b688-a8f96529606e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:47.123873 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-db539722-7911-4b8b-b688-a8f96529606e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:47.125849 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-db539722-7911-4b8b-b688-a8f96529606e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:47.136665 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-db539722-7911-4b8b-b688-a8f96529606e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:47.149784 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-db539722-7911-4b8b-b688-a8f96529606e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:47.286192 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-db539722-7911-4b8b-b688-a8f96529606e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:47.286192 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-db539722-7911-4b8b-b688-a8f96529606e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:47.286192 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.objects.instance [None req-db539722-7911-4b8b-b688-a8f96529606e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lazy-loading 'fault' on Instance uuid 11daa0bc-1e25-47d7-a6df-ffc808e1ff58 {{(pid=122567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 15 12:44:47.364754 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-db539722-7911-4b8b-b688-a8f96529606e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:47.374894 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-db539722-7911-4b8b-b688-a8f96529606e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:47.380051 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-db539722-7911-4b8b-b688-a8f96529606e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:44:47.382536 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-db539722-7911-4b8b-b688-a8f96529606e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 200 len: 1372 microversion: 2.20 time: 0.273070 Nov 15 12:44:47.400624 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 383/737] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:44:47 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 1372 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 15 12:44:47.463875 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-62abe3c1-73fc-4f3f-8b16-c4363ab2eec1 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Getting quotas for project b91bd39e4f3b40f396370b06f870aeb6. Resources: {'key_pairs'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:44:47.469007 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-62abe3c1-73fc-4f3f-8b16-c4363ab2eec1 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Getting quotas for user 1f4fb2fdbe754d13af2222261fddbbdc and project b91bd39e4f3b40f396370b06f870aeb6. Resources: {'key_pairs'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:44:47.494433 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-62abe3c1-73fc-4f3f-8b16-c4363ab2eec1 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.630477 Nov 15 12:44:47.501219 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 355/738] 10.222.0.43 () {60 vars in 1157 bytes} [Mon Nov 15 12:44:46 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:44:48.402123 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-a5bd06f3-5918-4a77-9951-0ac62361f300 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:48.403304 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-a5bd06f3-5918-4a77-9951-0ac62361f300 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:44:48.413355 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a5bd06f3-5918-4a77-9951-0ac62361f300 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:48.415217 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a5bd06f3-5918-4a77-9951-0ac62361f300 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:48.418498 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a5bd06f3-5918-4a77-9951-0ac62361f300 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:44:48.428282 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a5bd06f3-5918-4a77-9951-0ac62361f300 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:44:48.447340 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.wsgi [None req-a5bd06f3-5918-4a77-9951-0ac62361f300 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] HTTP exception thrown: Instance 11daa0bc-1e25-47d7-a6df-ffc808e1ff58 could not be found. Nov 15 12:44:48.448749 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-a5bd06f3-5918-4a77-9951-0ac62361f300 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Returning 404 to user: Instance 11daa0bc-1e25-47d7-a6df-ffc808e1ff58 could not be found. {{(pid=122567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:44:48.449895 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-a5bd06f3-5918-4a77-9951-0ac62361f300 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 404 len: 111 microversion: 2.20 time: 0.052570 Nov 15 12:44:48.454288 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 384/739] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:44:48 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 15 12:44:48.461273 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-ad3863b5-eff5-4ebf-a1da-41d25a7e1de3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '.version_select at 0x7f131b331dc0>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:44:48.517238 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-ad3863b5-eff5-4ebf-a1da-41d25a7e1de3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1261389376" status: 204 len: 0 microversion: 2.20 time: 0.060560 Nov 15 12:44:48.519666 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 356/740] 10.222.0.43 () {60 vars in 1261 bytes} [Mon Nov 15 12:44:48 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1261389376 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 15 12:44:50.122462 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-f4ff8d3d-df8e-4ce6-95b6-22aa747e7ed1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'create', calling method: .version_select at 0x7f132030ab80>, body: {"keypair": {"name": "tempest-keypair-177013178"}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:44:50.159121 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.quota [None req-f4ff8d3d-df8e-4ce6-95b6-22aa747e7ed1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Getting quotas for project 811d24506f5a47d0925645d4303dac8d. Resources: {'key_pairs'} {{(pid=122567) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:44:50.164277 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.quota [None req-f4ff8d3d-df8e-4ce6-95b6-22aa747e7ed1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Getting quotas for user 93fd9736646548b383d0c2600219c4f3 and project 811d24506f5a47d0925645d4303dac8d. Resources: {'key_pairs'} {{(pid=122567) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:44:50.237497 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-fe486729-598c-49c2-9901-3ca280afe225 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-385455371", "imageRef": "3cc21e2c-27da-4266-be76-369023341c16", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46d33d4a-084c-4c8a-b96d-1c2b35f75a03"}], "security_groups": [{"name": "tempest-securitygroup--2123846981"}], "key_name": "tempest-keypair-1588588195", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:44:50.475606 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.quota [None req-f4ff8d3d-df8e-4ce6-95b6-22aa747e7ed1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Getting quotas for project 811d24506f5a47d0925645d4303dac8d. Resources: {'key_pairs'} {{(pid=122567) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:44:50.480918 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.quota [None req-f4ff8d3d-df8e-4ce6-95b6-22aa747e7ed1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Getting quotas for user 93fd9736646548b383d0c2600219c4f3 and project 811d24506f5a47d0925645d4303dac8d. Resources: {'key_pairs'} {{(pid=122567) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:44:50.496991 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-f4ff8d3d-df8e-4ce6-95b6-22aa747e7ed1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.379762 Nov 15 12:44:50.497910 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 385/741] 10.222.0.43 () {62 vars in 1198 bytes} [Mon Nov 15 12:44:50 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 381 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 15 12:44:52.276765 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-cebae770-d259-4afb-9f2b-bb3a1010f9ea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1361954881", "imageRef": "3cc21e2c-27da-4266-be76-369023341c16", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f0a2cb68-3063-4051-80f9-d2c4ff88f485"}], "security_groups": [{"name": "tempest-securitygroup--459814656"}], "key_name": "tempest-keypair-177013178", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:00.540055 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.network.neutron [None req-fe486729-598c-49c2-9901-3ca280afe225 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] validate_networks() for [('46d33d4a-084c-4c8a-b96d-1c2b35f75a03', None, None, None, None, None)] {{(pid=122568) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 15 12:45:00.549218 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.network.neutron [None req-cebae770-d259-4afb-9f2b-bb3a1010f9ea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] validate_networks() for [('f0a2cb68-3063-4051-80f9-d2c4ff88f485', None, None, None, None, None)] {{(pid=122567) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 15 12:45:01.550803 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-fe486729-598c-49c2-9901-3ca280afe225 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Flavor limits 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 15 12:45:01.551386 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-cebae770-d259-4afb-9f2b-bb3a1010f9ea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Flavor limits 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 15 12:45:01.551774 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-fe486729-598c-49c2-9901-3ca280afe225 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Image limits 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 15 12:45:01.551859 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-cebae770-d259-4afb-9f2b-bb3a1010f9ea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Image limits 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 15 12:45:01.551859 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-cebae770-d259-4afb-9f2b-bb3a1010f9ea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Flavor pref 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 15 12:45:01.551998 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-fe486729-598c-49c2-9901-3ca280afe225 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Flavor pref 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 15 12:45:01.552305 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-fe486729-598c-49c2-9901-3ca280afe225 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Image pref 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 15 12:45:01.552624 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-cebae770-d259-4afb-9f2b-bb3a1010f9ea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Image pref 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 15 12:45:01.552893 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-cebae770-d259-4afb-9f2b-bb3a1010f9ea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 15 12:45:01.553415 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-fe486729-598c-49c2-9901-3ca280afe225 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 15 12:45:01.568034 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fe486729-598c-49c2-9901-3ca280afe225 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:01.568644 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fe486729-598c-49c2-9901-3ca280afe225 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:01.569823 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fe486729-598c-49c2-9901-3ca280afe225 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:01.570382 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fe486729-598c-49c2-9901-3ca280afe225 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:01.576364 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cebae770-d259-4afb-9f2b-bb3a1010f9ea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:01.577132 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cebae770-d259-4afb-9f2b-bb3a1010f9ea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:01.578243 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cebae770-d259-4afb-9f2b-bb3a1010f9ea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:01.578962 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cebae770-d259-4afb-9f2b-bb3a1010f9ea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:01.598601 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-fe486729-598c-49c2-9901-3ca280afe225 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Getting quotas for project b91bd39e4f3b40f396370b06f870aeb6. Resources: {'cores', 'ram', 'instances'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:45:01.599372 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.quota [None req-cebae770-d259-4afb-9f2b-bb3a1010f9ea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Getting quotas for project 811d24506f5a47d0925645d4303dac8d. Resources: {'cores', 'ram', 'instances'} {{(pid=122567) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:45:01.603275 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-fe486729-598c-49c2-9901-3ca280afe225 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Getting quotas for user 1f4fb2fdbe754d13af2222261fddbbdc and project b91bd39e4f3b40f396370b06f870aeb6. Resources: {'cores', 'ram', 'instances'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:45:01.604266 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.quota [None req-cebae770-d259-4afb-9f2b-bb3a1010f9ea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Getting quotas for user 93fd9736646548b383d0c2600219c4f3 and project 811d24506f5a47d0925645d4303dac8d. Resources: {'cores', 'ram', 'instances'} {{(pid=122567) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:45:01.617983 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-cebae770-d259-4afb-9f2b-bb3a1010f9ea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Going to run 1 instances... {{(pid=122567) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 15 12:45:01.618475 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-fe486729-598c-49c2-9901-3ca280afe225 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Going to run 1 instances... {{(pid=122568) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 15 12:45:01.621751 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-fe486729-598c-49c2-9901-3ca280afe225 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3cc21e2c-27da-4266-be76-369023341c16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 15 12:45:01.622368 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-cebae770-d259-4afb-9f2b-bb3a1010f9ea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3cc21e2c-27da-4266-be76-369023341c16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 15 12:45:01.681489 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-fe486729-598c-49c2-9901-3ca280afe225 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 11.449259 Nov 15 12:45:01.684942 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-cebae770-d259-4afb-9f2b-bb3a1010f9ea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 9.413315 Nov 15 12:45:01.688708 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 357/742] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Nov 15 12:44:50 2021] POST /compute/v2.1/servers => generated 402 bytes in 11457 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 15 12:45:01.695616 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-54cf369d-e312-49b8-8a9b-a1866dd5cc87 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:01.696446 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-54cf369d-e312-49b8-8a9b-a1866dd5cc87 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:01.713193 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 386/743] 10.222.0.43 () {62 vars in 1187 bytes} [Mon Nov 15 12:44:52 2021] POST /compute/v2.1/servers => generated 401 bytes in 9442 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 15 12:45:01.753535 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-27fc8097-b39c-483e-896b-37870a22d436 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:01.753535 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-27fc8097-b39c-483e-896b-37870a22d436 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:01.802220 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-54cf369d-e312-49b8-8a9b-a1866dd5cc87 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:01.809672 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-54cf369d-e312-49b8-8a9b-a1866dd5cc87 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847" status: 200 len: 1237 microversion: 2.1 time: 0.119539 Nov 15 12:45:01.819834 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 358/744] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:01 2021] GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847 => generated 1237 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:01.856266 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-27fc8097-b39c-483e-896b-37870a22d436 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:01.865086 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-27fc8097-b39c-483e-896b-37870a22d436 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:01.866481 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-27fc8097-b39c-483e-896b-37870a22d436 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:01.867614 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-27fc8097-b39c-483e-896b-37870a22d436 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1281 microversion: 2.20 time: 0.153033 Nov 15 12:45:01.868228 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 387/745] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:45:01 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1281 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:45:02.827475 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-30398e59-a1ff-4028-810a-e4a33dcb012a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:02.828112 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-30398e59-a1ff-4028-810a-e4a33dcb012a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:02.834983 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-30398e59-a1ff-4028-810a-e4a33dcb012a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:02.835431 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-30398e59-a1ff-4028-810a-e4a33dcb012a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:02.836201 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-30398e59-a1ff-4028-810a-e4a33dcb012a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:02.836631 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-30398e59-a1ff-4028-810a-e4a33dcb012a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:02.885896 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-c609b7d0-efe6-4c8d-bb3a-23fc46885b53 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:02.886863 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-c609b7d0-efe6-4c8d-bb3a-23fc46885b53 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:02.893495 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c609b7d0-efe6-4c8d-bb3a-23fc46885b53 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:02.894204 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c609b7d0-efe6-4c8d-bb3a-23fc46885b53 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:02.894738 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c609b7d0-efe6-4c8d-bb3a-23fc46885b53 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:02.895212 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c609b7d0-efe6-4c8d-bb3a-23fc46885b53 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:02.896304 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-30398e59-a1ff-4028-810a-e4a33dcb012a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:02.905149 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-30398e59-a1ff-4028-810a-e4a33dcb012a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847" status: 200 len: 1233 microversion: 2.1 time: 0.082240 Nov 15 12:45:02.905743 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 359/746] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:02 2021] GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847 => generated 1233 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:02.956128 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-c609b7d0-efe6-4c8d-bb3a-23fc46885b53 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:02.965092 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-c609b7d0-efe6-4c8d-bb3a-23fc46885b53 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:02.966654 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-c609b7d0-efe6-4c8d-bb3a-23fc46885b53 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:02.967784 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-c609b7d0-efe6-4c8d-bb3a-23fc46885b53 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1333 microversion: 2.20 time: 0.086175 Nov 15 12:45:02.968344 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 388/747] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:45:02 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1333 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 15 12:45:03.923319 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-ff7c8db2-8ca8-4072-b3f6-1f23ab1e2f32 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:03.924063 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-ff7c8db2-8ca8-4072-b3f6-1f23ab1e2f32 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:03.940535 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ff7c8db2-8ca8-4072-b3f6-1f23ab1e2f32 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:03.941758 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ff7c8db2-8ca8-4072-b3f6-1f23ab1e2f32 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:03.942605 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ff7c8db2-8ca8-4072-b3f6-1f23ab1e2f32 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:03.945330 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ff7c8db2-8ca8-4072-b3f6-1f23ab1e2f32 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:03.987499 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-efa19c2b-9c1e-4812-a440-0539e4e73e28 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:03.988382 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-efa19c2b-9c1e-4812-a440-0539e4e73e28 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:03.999322 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-efa19c2b-9c1e-4812-a440-0539e4e73e28 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:04.000362 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-efa19c2b-9c1e-4812-a440-0539e4e73e28 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:04.001383 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-efa19c2b-9c1e-4812-a440-0539e4e73e28 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:04.002009 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-efa19c2b-9c1e-4812-a440-0539e4e73e28 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:04.054761 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-ff7c8db2-8ca8-4072-b3f6-1f23ab1e2f32 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:04.069638 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-ff7c8db2-8ca8-4072-b3f6-1f23ab1e2f32 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847" status: 200 len: 1295 microversion: 2.1 time: 0.150131 Nov 15 12:45:04.071915 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 360/748] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:03 2021] GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847 => generated 1295 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:04.282475 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-efa19c2b-9c1e-4812-a440-0539e4e73e28 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:04.297520 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-efa19c2b-9c1e-4812-a440-0539e4e73e28 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:04.300941 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-efa19c2b-9c1e-4812-a440-0539e4e73e28 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:04.303110 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-efa19c2b-9c1e-4812-a440-0539e4e73e28 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1406 microversion: 2.20 time: 0.318975 Nov 15 12:45:04.303810 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 389/749] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:45:03 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1406 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:45:05.064343 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-71b43144-50d9-43be-9582-01fb0e868d6b req-53bddb0d-91c5-4408-98b0-db13bafb68dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12e0ab18-a841-4228-bebb-1c5d1db6f7f6", "tag": "ffefc1bf-d747-45f6-8979-9a984c11ed67"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:05.066067 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:45:05.066067 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:45:05.079875 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-71b43144-50d9-43be-9582-01fb0e868d6b req-53bddb0d-91c5-4408-98b0-db13bafb68dd service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:05.080334 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-71b43144-50d9-43be-9582-01fb0e868d6b req-53bddb0d-91c5-4408-98b0-db13bafb68dd service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:05.096114 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-058f254f-6464-4889-abee-b98f685e1810 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:05.098154 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-058f254f-6464-4889-abee-b98f685e1810 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:05.108010 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-058f254f-6464-4889-abee-b98f685e1810 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:05.109525 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-058f254f-6464-4889-abee-b98f685e1810 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:05.110927 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-058f254f-6464-4889-abee-b98f685e1810 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:05.111587 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-058f254f-6464-4889-abee-b98f685e1810 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:05.115789 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-71b43144-50d9-43be-9582-01fb0e868d6b req-53bddb0d-91c5-4408-98b0-db13bafb68dd service nova] Creating event network-changed:ffefc1bf-d747-45f6-8979-9a984c11ed67 for instance 12e0ab18-a841-4228-bebb-1c5d1db6f7f6 on hv-cinder-68088 Nov 15 12:45:05.129524 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-71b43144-50d9-43be-9582-01fb0e868d6b req-53bddb0d-91c5-4408-98b0-db13bafb68dd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072338 Nov 15 12:45:05.130705 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 361/750] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:45:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:45:05.323117 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-c7cdc65e-32bb-413d-b273-884d2be3426e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:05.323841 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-c7cdc65e-32bb-413d-b273-884d2be3426e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:05.336865 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c7cdc65e-32bb-413d-b273-884d2be3426e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:05.337693 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c7cdc65e-32bb-413d-b273-884d2be3426e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:05.339115 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c7cdc65e-32bb-413d-b273-884d2be3426e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:05.339814 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c7cdc65e-32bb-413d-b273-884d2be3426e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:05.600369 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-058f254f-6464-4889-abee-b98f685e1810 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:05.612237 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-058f254f-6464-4889-abee-b98f685e1810 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847" status: 200 len: 1363 microversion: 2.1 time: 0.526072 Nov 15 12:45:05.613778 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 390/751] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:05 2021] GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847 => generated 1363 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:05.759027 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-c7cdc65e-32bb-413d-b273-884d2be3426e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:05.770662 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-c7cdc65e-32bb-413d-b273-884d2be3426e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:05.772204 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-c7cdc65e-32bb-413d-b273-884d2be3426e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:05.773292 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-c7cdc65e-32bb-413d-b273-884d2be3426e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1406 microversion: 2.20 time: 0.454827 Nov 15 12:45:05.783664 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 362/752] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:45:05 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1406 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 15 12:45:06.085252 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [req-ebea3f64-797f-4846-b14d-db458cbd9f16 req-daad64a7-4a6e-490e-ae1d-afe56d1650da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ceda11b-c435-4946-bbc9-f6ce1134e847", "tag": "133aca31-05be-4a7b-9476-e523e5c06e27"}]} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:06.086881 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:45:06.086881 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: warnings.warn(msg) Nov 15 12:45:06.096410 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-ebea3f64-797f-4846-b14d-db458cbd9f16 req-daad64a7-4a6e-490e-ae1d-afe56d1650da service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:06.097039 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-ebea3f64-797f-4846-b14d-db458cbd9f16 req-daad64a7-4a6e-490e-ae1d-afe56d1650da service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:06.111651 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.compute.server_external_events [req-ebea3f64-797f-4846-b14d-db458cbd9f16 req-daad64a7-4a6e-490e-ae1d-afe56d1650da service nova] Creating event network-changed:133aca31-05be-4a7b-9476-e523e5c06e27 for instance 0ceda11b-c435-4946-bbc9-f6ce1134e847 on hv-cinder-68088 Nov 15 12:45:06.122118 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [req-ebea3f64-797f-4846-b14d-db458cbd9f16 req-daad64a7-4a6e-490e-ae1d-afe56d1650da service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136997 Nov 15 12:45:06.122729 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 391/753] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:45:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:45:06.631888 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-fc405430-ca38-4a22-9459-d501b6caa2b6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:06.632349 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-fc405430-ca38-4a22-9459-d501b6caa2b6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:06.649534 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fc405430-ca38-4a22-9459-d501b6caa2b6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:06.649985 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fc405430-ca38-4a22-9459-d501b6caa2b6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:06.651744 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fc405430-ca38-4a22-9459-d501b6caa2b6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:06.652179 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fc405430-ca38-4a22-9459-d501b6caa2b6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:06.787510 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e5ddbc00-eb4c-4544-a0b5-36c904c94c46 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2113817233", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1935274887", "security_groups": [{"name": "tempest-secgroup-smoke-1331826370"}], "block_device_mapping_v2": [{"uuid": "aa5f8226-b6ac-42dc-b928-eb2e166f7436", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f4599fcb-fdea-4045-9c9c-3e445269e7ec"}]}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:06.895239 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-fc405430-ca38-4a22-9459-d501b6caa2b6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:06.904311 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-fc405430-ca38-4a22-9459-d501b6caa2b6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847" status: 200 len: 1363 microversion: 2.1 time: 0.277056 Nov 15 12:45:06.913842 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 363/754] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:06 2021] GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847 => generated 1363 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:06.913842 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-25dbd2bf-2ab8-4e78-bfae-3541a48ae391 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:06.913842 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-25dbd2bf-2ab8-4e78-bfae-3541a48ae391 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:06.918983 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-25dbd2bf-2ab8-4e78-bfae-3541a48ae391 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:06.919429 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-25dbd2bf-2ab8-4e78-bfae-3541a48ae391 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:06.920218 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-25dbd2bf-2ab8-4e78-bfae-3541a48ae391 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:06.920648 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-25dbd2bf-2ab8-4e78-bfae-3541a48ae391 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:06.977864 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.network.neutron [None req-e5ddbc00-eb4c-4544-a0b5-36c904c94c46 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] validate_networks() for [('f4599fcb-fdea-4045-9c9c-3e445269e7ec', None, None, None, None, None)] {{(pid=122567) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 15 12:45:07.280031 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-25dbd2bf-2ab8-4e78-bfae-3541a48ae391 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:07.291810 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-25dbd2bf-2ab8-4e78-bfae-3541a48ae391 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:07.293163 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-25dbd2bf-2ab8-4e78-bfae-3541a48ae391 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:07.294286 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-25dbd2bf-2ab8-4e78-bfae-3541a48ae391 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1406 microversion: 2.20 time: 0.387539 Nov 15 12:45:07.294880 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 364/755] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:45:06 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1406 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:45:07.677017 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-e5ddbc00-eb4c-4544-a0b5-36c904c94c46 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Flavor limits 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 15 12:45:07.677522 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-e5ddbc00-eb4c-4544-a0b5-36c904c94c46 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Image limits 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 15 12:45:07.677890 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-e5ddbc00-eb4c-4544-a0b5-36c904c94c46 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Flavor pref 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 15 12:45:07.678289 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-e5ddbc00-eb4c-4544-a0b5-36c904c94c46 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Image pref 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 15 12:45:07.678696 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-e5ddbc00-eb4c-4544-a0b5-36c904c94c46 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 15 12:45:07.688519 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e5ddbc00-eb4c-4544-a0b5-36c904c94c46 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:07.688623 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e5ddbc00-eb4c-4544-a0b5-36c904c94c46 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:07.689359 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e5ddbc00-eb4c-4544-a0b5-36c904c94c46 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:07.689788 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e5ddbc00-eb4c-4544-a0b5-36c904c94c46 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:07.706386 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.quota [None req-e5ddbc00-eb4c-4544-a0b5-36c904c94c46 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Getting quotas for project f78fedf356a24ea182428c85682330f1. Resources: {'cores', 'ram', 'instances'} {{(pid=122567) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:45:07.710662 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.quota [None req-e5ddbc00-eb4c-4544-a0b5-36c904c94c46 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Getting quotas for user 84c8f2a4f7c84026859778c12d6f7c35 and project f78fedf356a24ea182428c85682330f1. Resources: {'cores', 'ram', 'instances'} {{(pid=122567) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:45:07.766410 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e5ddbc00-eb4c-4544-a0b5-36c904c94c46 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Going to run 1 instances... {{(pid=122567) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 15 12:45:07.768674 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e5ddbc00-eb4c-4544-a0b5-36c904c94c46 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aa5f8226-b6ac-42dc-b928-eb2e166f7436',volume_size=None,volume_type=None)] {{(pid=122567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 15 12:45:07.903131 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e5ddbc00-eb4c-4544-a0b5-36c904c94c46 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.119763 Nov 15 12:45:07.904575 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 392/756] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Nov 15 12:45:06 2021] POST /compute/v2.1/servers => generated 406 bytes in 1122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 15 12:45:07.915737 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-9039b1b2-921c-460b-a50e-384c81c232dd tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:07.918597 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-9039b1b2-921c-460b-a50e-384c81c232dd tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:07.936089 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-21a31bd4-4cdf-4a3b-90ce-5c6babef4831 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:07.936707 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-21a31bd4-4cdf-4a3b-90ce-5c6babef4831 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:07.946639 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-21a31bd4-4cdf-4a3b-90ce-5c6babef4831 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:07.947135 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-21a31bd4-4cdf-4a3b-90ce-5c6babef4831 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:07.948644 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-21a31bd4-4cdf-4a3b-90ce-5c6babef4831 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:07.949446 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-21a31bd4-4cdf-4a3b-90ce-5c6babef4831 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:08.006448 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-9039b1b2-921c-460b-a50e-384c81c232dd tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:08.017802 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-9039b1b2-921c-460b-a50e-384c81c232dd tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2" status: 200 len: 1095 microversion: 2.1 time: 0.105808 Nov 15 12:45:08.019104 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 365/757] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:07 2021] GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2 => generated 1095 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:45:08.117094 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-21a31bd4-4cdf-4a3b-90ce-5c6babef4831 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:08.125131 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-21a31bd4-4cdf-4a3b-90ce-5c6babef4831 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847" status: 200 len: 1363 microversion: 2.1 time: 0.207157 Nov 15 12:45:08.125948 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 393/758] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:07 2021] GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847 => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:08.316443 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-6c6256b9-0bec-4cce-b133-941e55309b41 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:08.317358 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-6c6256b9-0bec-4cce-b133-941e55309b41 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:08.325342 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6c6256b9-0bec-4cce-b133-941e55309b41 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:08.325342 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6c6256b9-0bec-4cce-b133-941e55309b41 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:08.327359 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6c6256b9-0bec-4cce-b133-941e55309b41 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:08.328052 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6c6256b9-0bec-4cce-b133-941e55309b41 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:08.474100 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-6c6256b9-0bec-4cce-b133-941e55309b41 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:08.484069 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-6c6256b9-0bec-4cce-b133-941e55309b41 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:08.486309 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-6c6256b9-0bec-4cce-b133-941e55309b41 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:08.487667 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-6c6256b9-0bec-4cce-b133-941e55309b41 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1406 microversion: 2.20 time: 0.175192 Nov 15 12:45:08.488431 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 366/759] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:45:08 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:45:09.034590 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-9a23665c-efa7-4862-b844-edbe8c5fe815 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:09.035993 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-9a23665c-efa7-4862-b844-edbe8c5fe815 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:09.043658 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9a23665c-efa7-4862-b844-edbe8c5fe815 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:09.044212 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9a23665c-efa7-4862-b844-edbe8c5fe815 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:09.045251 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9a23665c-efa7-4862-b844-edbe8c5fe815 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:09.046220 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9a23665c-efa7-4862-b844-edbe8c5fe815 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:09.142349 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-ebd892e0-cd15-4d02-b88a-d32c2dcd019a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:09.150098 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-ebd892e0-cd15-4d02-b88a-d32c2dcd019a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:09.150098 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ebd892e0-cd15-4d02-b88a-d32c2dcd019a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:09.152139 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ebd892e0-cd15-4d02-b88a-d32c2dcd019a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:09.156893 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ebd892e0-cd15-4d02-b88a-d32c2dcd019a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:09.156893 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ebd892e0-cd15-4d02-b88a-d32c2dcd019a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:09.301629 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-9a23665c-efa7-4862-b844-edbe8c5fe815 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:09.313099 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-9a23665c-efa7-4862-b844-edbe8c5fe815 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2" status: 200 len: 1211 microversion: 2.1 time: 0.281350 Nov 15 12:45:09.320293 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 394/760] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:09 2021] GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2 => generated 1211 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:09.449281 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-ebd892e0-cd15-4d02-b88a-d32c2dcd019a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:09.456782 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-ebd892e0-cd15-4d02-b88a-d32c2dcd019a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847" status: 200 len: 1363 microversion: 2.1 time: 0.318044 Nov 15 12:45:09.467609 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 367/761] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:09 2021] GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847 => generated 1363 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:45:09.507533 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-0afd3935-197e-4c77-9f19-92225d243daf tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:09.508562 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-0afd3935-197e-4c77-9f19-92225d243daf tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:09.516105 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0afd3935-197e-4c77-9f19-92225d243daf tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:09.516914 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0afd3935-197e-4c77-9f19-92225d243daf tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:09.517999 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0afd3935-197e-4c77-9f19-92225d243daf tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:09.518565 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0afd3935-197e-4c77-9f19-92225d243daf tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:09.735501 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-0afd3935-197e-4c77-9f19-92225d243daf tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:09.753978 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-0afd3935-197e-4c77-9f19-92225d243daf tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:09.756091 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-0afd3935-197e-4c77-9f19-92225d243daf tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:09.757758 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-0afd3935-197e-4c77-9f19-92225d243daf tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1406 microversion: 2.20 time: 0.254268 Nov 15 12:45:09.758916 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 395/762] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:45:09 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1406 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:45:10.331834 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-b81bfc7b-80d1-4f3f-ad16-3053b7954f5a tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:10.332492 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-b81bfc7b-80d1-4f3f-ad16-3053b7954f5a tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:10.341531 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b81bfc7b-80d1-4f3f-ad16-3053b7954f5a tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:10.342308 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b81bfc7b-80d1-4f3f-ad16-3053b7954f5a tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:10.343773 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b81bfc7b-80d1-4f3f-ad16-3053b7954f5a tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:10.345009 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b81bfc7b-80d1-4f3f-ad16-3053b7954f5a tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:10.474494 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-7e6bc4f5-cdaa-46b4-9a6b-8e7099f81554 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:10.475358 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-7e6bc4f5-cdaa-46b4-9a6b-8e7099f81554 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:10.483549 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7e6bc4f5-cdaa-46b4-9a6b-8e7099f81554 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:10.483997 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7e6bc4f5-cdaa-46b4-9a6b-8e7099f81554 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:10.485061 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7e6bc4f5-cdaa-46b4-9a6b-8e7099f81554 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:10.485667 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7e6bc4f5-cdaa-46b4-9a6b-8e7099f81554 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:10.668854 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-b81bfc7b-80d1-4f3f-ad16-3053b7954f5a tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:10.676627 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-b81bfc7b-80d1-4f3f-ad16-3053b7954f5a tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2" status: 200 len: 1267 microversion: 2.1 time: 0.348377 Nov 15 12:45:10.677206 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 368/763] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:10 2021] GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2 => generated 1267 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:10.751363 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-7e6bc4f5-cdaa-46b4-9a6b-8e7099f81554 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:10.761682 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-7e6bc4f5-cdaa-46b4-9a6b-8e7099f81554 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847" status: 200 len: 1363 microversion: 2.1 time: 0.290793 Nov 15 12:45:10.774109 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 396/764] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:10 2021] GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847 => generated 1363 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:45:10.777856 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-906d27b7-eef7-4a55-aed1-6a0713e6ebeb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:10.778696 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-906d27b7-eef7-4a55-aed1-6a0713e6ebeb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:10.786049 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-906d27b7-eef7-4a55-aed1-6a0713e6ebeb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:10.786551 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-906d27b7-eef7-4a55-aed1-6a0713e6ebeb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:10.787518 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-906d27b7-eef7-4a55-aed1-6a0713e6ebeb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:10.787949 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-906d27b7-eef7-4a55-aed1-6a0713e6ebeb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:11.027134 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-906d27b7-eef7-4a55-aed1-6a0713e6ebeb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:11.036449 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-906d27b7-eef7-4a55-aed1-6a0713e6ebeb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:11.038099 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-906d27b7-eef7-4a55-aed1-6a0713e6ebeb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:11.039278 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-906d27b7-eef7-4a55-aed1-6a0713e6ebeb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1406 microversion: 2.20 time: 0.266670 Nov 15 12:45:11.040020 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 369/765] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:45:10 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1406 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 15 12:45:11.150253 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [req-5f060d06-b7d8-4c94-8fa8-4cfbd5922d36 req-4674a8fc-d6ca-4952-abb4-cfd1aab6faba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2", "tag": "e4e6fc76-abc6-4e8a-8982-935e5e678851"}]} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:11.152742 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:45:11.152742 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: warnings.warn(msg) Nov 15 12:45:11.159863 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-5f060d06-b7d8-4c94-8fa8-4cfbd5922d36 req-4674a8fc-d6ca-4952-abb4-cfd1aab6faba service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:11.160302 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-5f060d06-b7d8-4c94-8fa8-4cfbd5922d36 req-4674a8fc-d6ca-4952-abb4-cfd1aab6faba service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:11.178653 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.compute.server_external_events [req-5f060d06-b7d8-4c94-8fa8-4cfbd5922d36 req-4674a8fc-d6ca-4952-abb4-cfd1aab6faba service nova] Creating event network-changed:e4e6fc76-abc6-4e8a-8982-935e5e678851 for instance f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2 on hv-cinder-68088 Nov 15 12:45:11.185107 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [req-5f060d06-b7d8-4c94-8fa8-4cfbd5922d36 req-4674a8fc-d6ca-4952-abb4-cfd1aab6faba service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052130 Nov 15 12:45:11.186148 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 397/766] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:45:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:45:11.439963 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-1a54ba55-256d-4fcf-ba5b-6372340cc661 req-a9b567db-c36f-4ac6-8a0e-7a073b15cfe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ceda11b-c435-4946-bbc9-f6ce1134e847", "name": "network-vif-plugged", "status": "completed", "tag": "133aca31-05be-4a7b-9476-e523e5c06e27"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:11.441735 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:45:11.441735 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:45:11.449684 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-1a54ba55-256d-4fcf-ba5b-6372340cc661 req-a9b567db-c36f-4ac6-8a0e-7a073b15cfe8 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:11.450114 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-1a54ba55-256d-4fcf-ba5b-6372340cc661 req-a9b567db-c36f-4ac6-8a0e-7a073b15cfe8 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:11.464221 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-1a54ba55-256d-4fcf-ba5b-6372340cc661 req-a9b567db-c36f-4ac6-8a0e-7a073b15cfe8 service nova] Creating event network-vif-plugged:133aca31-05be-4a7b-9476-e523e5c06e27 for instance 0ceda11b-c435-4946-bbc9-f6ce1134e847 on hv-cinder-68088 Nov 15 12:45:11.469822 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-1a54ba55-256d-4fcf-ba5b-6372340cc661 req-a9b567db-c36f-4ac6-8a0e-7a073b15cfe8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033627 Nov 15 12:45:11.471243 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 370/767] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:45:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:45:11.694214 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-4798fb3e-8e24-4b22-ac89-f3653fe48a9c tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:11.699790 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-4798fb3e-8e24-4b22-ac89-f3653fe48a9c tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:11.709492 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4798fb3e-8e24-4b22-ac89-f3653fe48a9c tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:11.710379 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4798fb3e-8e24-4b22-ac89-f3653fe48a9c tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:11.711370 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4798fb3e-8e24-4b22-ac89-f3653fe48a9c tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:11.712066 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4798fb3e-8e24-4b22-ac89-f3653fe48a9c tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:11.780332 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-5bdcd2e9-b951-48bb-a039-56480a58024a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:11.781032 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-5bdcd2e9-b951-48bb-a039-56480a58024a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:11.795477 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5bdcd2e9-b951-48bb-a039-56480a58024a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:11.796087 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5bdcd2e9-b951-48bb-a039-56480a58024a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:11.796891 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5bdcd2e9-b951-48bb-a039-56480a58024a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:11.797321 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5bdcd2e9-b951-48bb-a039-56480a58024a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:11.995362 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-4798fb3e-8e24-4b22-ac89-f3653fe48a9c tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:12.003098 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-4798fb3e-8e24-4b22-ac89-f3653fe48a9c tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2" status: 200 len: 1267 microversion: 2.1 time: 0.313263 Nov 15 12:45:12.003664 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 398/768] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:11 2021] GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2 => generated 1267 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:12.052379 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-5bdcd2e9-b951-48bb-a039-56480a58024a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:12.057561 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-a4e2b11d-e7a7-49f8-af23-068167d0c8c8 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:12.058155 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-a4e2b11d-e7a7-49f8-af23-068167d0c8c8 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:12.064562 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a4e2b11d-e7a7-49f8-af23-068167d0c8c8 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:12.065017 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a4e2b11d-e7a7-49f8-af23-068167d0c8c8 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:12.065531 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-5bdcd2e9-b951-48bb-a039-56480a58024a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847" status: 200 len: 1363 microversion: 2.1 time: 0.289301 Nov 15 12:45:12.065806 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a4e2b11d-e7a7-49f8-af23-068167d0c8c8 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:12.065944 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 371/769] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:11 2021] GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847 => generated 1363 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:12.066241 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a4e2b11d-e7a7-49f8-af23-068167d0c8c8 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:12.205130 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-a4e2b11d-e7a7-49f8-af23-068167d0c8c8 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:12.214290 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-a4e2b11d-e7a7-49f8-af23-068167d0c8c8 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:12.215824 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-a4e2b11d-e7a7-49f8-af23-068167d0c8c8 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:12.217104 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-a4e2b11d-e7a7-49f8-af23-068167d0c8c8 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1406 microversion: 2.20 time: 0.163444 Nov 15 12:45:12.217570 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 399/770] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:45:12 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:45:13.020496 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-5bd8856f-7b9e-4297-8d3c-252ff7f75ab8 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:13.021695 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-5bd8856f-7b9e-4297-8d3c-252ff7f75ab8 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:13.028710 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5bd8856f-7b9e-4297-8d3c-252ff7f75ab8 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:13.029158 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5bd8856f-7b9e-4297-8d3c-252ff7f75ab8 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:13.029926 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5bd8856f-7b9e-4297-8d3c-252ff7f75ab8 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:13.030353 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5bd8856f-7b9e-4297-8d3c-252ff7f75ab8 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:13.082590 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-77c1cd13-75b7-47a3-ba2c-04badf827121 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:13.083393 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-77c1cd13-75b7-47a3-ba2c-04badf827121 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:13.091172 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-77c1cd13-75b7-47a3-ba2c-04badf827121 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:13.091758 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-77c1cd13-75b7-47a3-ba2c-04badf827121 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:13.092788 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-77c1cd13-75b7-47a3-ba2c-04badf827121 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:13.093404 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-77c1cd13-75b7-47a3-ba2c-04badf827121 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:13.201099 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-5bd8856f-7b9e-4297-8d3c-252ff7f75ab8 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:13.211002 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-5bd8856f-7b9e-4297-8d3c-252ff7f75ab8 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2" status: 200 len: 1267 microversion: 2.1 time: 0.193860 Nov 15 12:45:13.211651 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 372/771] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:13 2021] GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2 => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:13.236214 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-e923b6fd-3799-4ccf-be91-8e90a225670f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:13.237211 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-e923b6fd-3799-4ccf-be91-8e90a225670f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:13.243649 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e923b6fd-3799-4ccf-be91-8e90a225670f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:13.244915 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e923b6fd-3799-4ccf-be91-8e90a225670f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:13.245868 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e923b6fd-3799-4ccf-be91-8e90a225670f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:13.246282 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e923b6fd-3799-4ccf-be91-8e90a225670f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:13.303131 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-77c1cd13-75b7-47a3-ba2c-04badf827121 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:13.313194 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-77c1cd13-75b7-47a3-ba2c-04badf827121 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847" status: 200 len: 1548 microversion: 2.1 time: 0.233366 Nov 15 12:45:13.324648 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 400/772] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:13 2021] GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847 => generated 1548 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:45:13.330630 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-37c2809f-0bce-455f-bdc1-757e431dcfca tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:13.331173 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-37c2809f-0bce-455f-bdc1-757e431dcfca tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:13.337087 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-37c2809f-0bce-455f-bdc1-757e431dcfca tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:13.337541 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-37c2809f-0bce-455f-bdc1-757e431dcfca tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:13.338376 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-37c2809f-0bce-455f-bdc1-757e431dcfca tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:13.338917 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-37c2809f-0bce-455f-bdc1-757e431dcfca tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:13.424134 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-e923b6fd-3799-4ccf-be91-8e90a225670f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:13.433174 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-e923b6fd-3799-4ccf-be91-8e90a225670f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:13.434825 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-e923b6fd-3799-4ccf-be91-8e90a225670f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:13.435965 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-e923b6fd-3799-4ccf-be91-8e90a225670f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1406 microversion: 2.20 time: 0.204364 Nov 15 12:45:13.436532 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 373/773] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:45:13 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:45:13.445147 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-37c2809f-0bce-455f-bdc1-757e431dcfca tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.118208 Nov 15 12:45:13.445728 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 401/774] 10.222.0.43 () {58 vars in 1274 bytes} [Mon Nov 15 12:45:13 2021] GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:45:13.507342 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-2448a1cb-4daf-47a7-805b-57c6b41a48f9 req-31b1c36e-0db6-4d82-a06d-0759becb846c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12e0ab18-a841-4228-bebb-1c5d1db6f7f6", "name": "network-vif-plugged", "status": "completed", "tag": "ffefc1bf-d747-45f6-8979-9a984c11ed67"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:13.508961 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:45:13.508961 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:45:13.516126 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-2448a1cb-4daf-47a7-805b-57c6b41a48f9 req-31b1c36e-0db6-4d82-a06d-0759becb846c service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:13.516559 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-2448a1cb-4daf-47a7-805b-57c6b41a48f9 req-31b1c36e-0db6-4d82-a06d-0759becb846c service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:13.527783 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-2448a1cb-4daf-47a7-805b-57c6b41a48f9 req-31b1c36e-0db6-4d82-a06d-0759becb846c service nova] Creating event network-vif-plugged:ffefc1bf-d747-45f6-8979-9a984c11ed67 for instance 12e0ab18-a841-4228-bebb-1c5d1db6f7f6 on hv-cinder-68088 Nov 15 12:45:13.532600 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-2448a1cb-4daf-47a7-805b-57c6b41a48f9 req-31b1c36e-0db6-4d82-a06d-0759becb846c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028797 Nov 15 12:45:13.533189 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 374/775] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:45:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:45:14.228673 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-554d9d25-e3b1-46c1-a6f7-ac517f341df0 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:14.229963 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-554d9d25-e3b1-46c1-a6f7-ac517f341df0 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:14.236420 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-554d9d25-e3b1-46c1-a6f7-ac517f341df0 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:14.236977 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-554d9d25-e3b1-46c1-a6f7-ac517f341df0 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:14.237754 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-554d9d25-e3b1-46c1-a6f7-ac517f341df0 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:14.238176 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-554d9d25-e3b1-46c1-a6f7-ac517f341df0 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:14.455811 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-882910a6-7f59-49d5-a8f1-10896768dff1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:14.457107 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-882910a6-7f59-49d5-a8f1-10896768dff1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:14.465557 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-882910a6-7f59-49d5-a8f1-10896768dff1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:14.466386 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-882910a6-7f59-49d5-a8f1-10896768dff1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:14.467502 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-882910a6-7f59-49d5-a8f1-10896768dff1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:14.468281 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-882910a6-7f59-49d5-a8f1-10896768dff1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:14.743422 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-554d9d25-e3b1-46c1-a6f7-ac517f341df0 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:14.752071 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-554d9d25-e3b1-46c1-a6f7-ac517f341df0 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2" status: 200 len: 1267 microversion: 2.1 time: 0.527673 Nov 15 12:45:14.752657 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 402/776] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:14 2021] GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2 => generated 1267 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:14.776834 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-882910a6-7f59-49d5-a8f1-10896768dff1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:14.784763 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-882910a6-7f59-49d5-a8f1-10896768dff1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:14.786384 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-882910a6-7f59-49d5-a8f1-10896768dff1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:14.787388 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-882910a6-7f59-49d5-a8f1-10896768dff1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1406 microversion: 2.20 time: 0.336757 Nov 15 12:45:14.787952 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 375/777] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:45:14 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1406 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 15 12:45:14.944908 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-3b493e1f-a61c-42b4-bfa8-aa94510ca657 req-dabb09c2-c637-4a8c-9ddb-8ffd4389e444 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ceda11b-c435-4946-bbc9-f6ce1134e847", "tag": "133aca31-05be-4a7b-9476-e523e5c06e27"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:14.946553 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:45:14.946553 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:45:14.950522 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-2f364c3c-aa47-479b-8b15-4b25452c9906 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:14.951609 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-2f364c3c-aa47-479b-8b15-4b25452c9906 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:14.958151 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2f364c3c-aa47-479b-8b15-4b25452c9906 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:14.958652 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2f364c3c-aa47-479b-8b15-4b25452c9906 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:14.959360 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-3b493e1f-a61c-42b4-bfa8-aa94510ca657 req-dabb09c2-c637-4a8c-9ddb-8ffd4389e444 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:14.959519 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2f364c3c-aa47-479b-8b15-4b25452c9906 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:14.959908 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2f364c3c-aa47-479b-8b15-4b25452c9906 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:14.960092 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-3b493e1f-a61c-42b4-bfa8-aa94510ca657 req-dabb09c2-c637-4a8c-9ddb-8ffd4389e444 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:14.971615 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-3b493e1f-a61c-42b4-bfa8-aa94510ca657 req-dabb09c2-c637-4a8c-9ddb-8ffd4389e444 service nova] Creating event network-changed:133aca31-05be-4a7b-9476-e523e5c06e27 for instance 0ceda11b-c435-4946-bbc9-f6ce1134e847 on hv-cinder-68088 Nov 15 12:45:14.976582 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-3b493e1f-a61c-42b4-bfa8-aa94510ca657 req-dabb09c2-c637-4a8c-9ddb-8ffd4389e444 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035156 Nov 15 12:45:14.977493 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 376/778] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:45:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:45:15.074134 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-2f364c3c-aa47-479b-8b15-4b25452c9906 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 14 microversion: 2.1 time: 0.137476 Nov 15 12:45:15.077564 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 403/779] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:14 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 15 12:45:15.770127 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-0d40840a-b945-4cf9-85f3-7114c97d85aa tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:15.770835 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-0d40840a-b945-4cf9-85f3-7114c97d85aa tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:15.777680 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0d40840a-b945-4cf9-85f3-7114c97d85aa tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:15.778112 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0d40840a-b945-4cf9-85f3-7114c97d85aa tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:15.778967 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0d40840a-b945-4cf9-85f3-7114c97d85aa tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:15.779389 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0d40840a-b945-4cf9-85f3-7114c97d85aa tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:15.805864 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e9ff4193-99b2-4a75-a8c9-809260c78c89 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:15.806732 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e9ff4193-99b2-4a75-a8c9-809260c78c89 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:15.813917 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e9ff4193-99b2-4a75-a8c9-809260c78c89 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:15.814357 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e9ff4193-99b2-4a75-a8c9-809260c78c89 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:15.815156 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e9ff4193-99b2-4a75-a8c9-809260c78c89 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:15.815577 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e9ff4193-99b2-4a75-a8c9-809260c78c89 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:15.983859 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-0d40840a-b945-4cf9-85f3-7114c97d85aa tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:15.991790 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-0d40840a-b945-4cf9-85f3-7114c97d85aa tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2" status: 200 len: 1267 microversion: 2.1 time: 0.225982 Nov 15 12:45:15.992365 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 377/780] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:15 2021] GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2 => generated 1267 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:16.007096 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-d519814a-d73c-450f-b852-ccf5d136925d tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:16.007883 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-d519814a-d73c-450f-b852-ccf5d136925d tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:16.013523 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e9ff4193-99b2-4a75-a8c9-809260c78c89 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:16.015023 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d519814a-d73c-450f-b852-ccf5d136925d tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:16.015639 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d519814a-d73c-450f-b852-ccf5d136925d tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:16.016615 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d519814a-d73c-450f-b852-ccf5d136925d tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:16.017034 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d519814a-d73c-450f-b852-ccf5d136925d tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:16.025756 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e9ff4193-99b2-4a75-a8c9-809260c78c89 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:16.028070 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e9ff4193-99b2-4a75-a8c9-809260c78c89 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:16.029500 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e9ff4193-99b2-4a75-a8c9-809260c78c89 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1598 microversion: 2.20 time: 0.227587 Nov 15 12:45:16.042919 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 404/781] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:45:15 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1598 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:45:16.048941 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-0644311f-841e-43c8-8c2b-d3901054be5a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:16.049431 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-0644311f-841e-43c8-8c2b-d3901054be5a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:16.054964 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.objects.instance [None req-d519814a-d73c-450f-b852-ccf5d136925d tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lazy-loading 'flavor' on Instance uuid a56962f0-d8f9-4778-a21e-1f2bc81789fe {{(pid=122568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 15 12:45:16.061815 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0644311f-841e-43c8-8c2b-d3901054be5a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:16.062261 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0644311f-841e-43c8-8c2b-d3901054be5a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:16.063076 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0644311f-841e-43c8-8c2b-d3901054be5a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:16.063503 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0644311f-841e-43c8-8c2b-d3901054be5a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:16.143191 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-d519814a-d73c-450f-b852-ccf5d136925d tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "POST /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe/action" status: 202 len: 0 microversion: 2.1 time: 0.139522 Nov 15 12:45:16.143909 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 378/782] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:16 2021] POST /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:45:16.151315 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-57c53bae-b78a-4817-b81e-289e00553259 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:16.152433 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-57c53bae-b78a-4817-b81e-289e00553259 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:16.159029 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-57c53bae-b78a-4817-b81e-289e00553259 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:16.159541 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-57c53bae-b78a-4817-b81e-289e00553259 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:16.160380 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-57c53bae-b78a-4817-b81e-289e00553259 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:16.160603 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-0644311f-841e-43c8-8c2b-d3901054be5a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.115061 Nov 15 12:45:16.160925 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-57c53bae-b78a-4817-b81e-289e00553259 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:16.161207 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 405/783] 10.222.0.43 () {60 vars in 1315 bytes} [Mon Nov 15 12:45:16 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:45:16.169684 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-d6349796-d91c-43cc-85de-00e356c0a119 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:16.170299 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-d6349796-d91c-43cc-85de-00e356c0a119 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:16.179429 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d6349796-d91c-43cc-85de-00e356c0a119 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:16.180704 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d6349796-d91c-43cc-85de-00e356c0a119 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:16.181749 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d6349796-d91c-43cc-85de-00e356c0a119 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:16.182686 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d6349796-d91c-43cc-85de-00e356c0a119 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:16.332603 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-d6349796-d91c-43cc-85de-00e356c0a119 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:16.340510 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-d6349796-d91c-43cc-85de-00e356c0a119 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1570 microversion: 2.1 time: 0.178041 Nov 15 12:45:16.348626 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 406/784] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:16 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1570 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:17.008484 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-3d58acd2-e7cc-49ea-a2cf-68348fb87745 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:17.009117 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-3d58acd2-e7cc-49ea-a2cf-68348fb87745 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:17.016026 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3d58acd2-e7cc-49ea-a2cf-68348fb87745 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:17.016469 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3d58acd2-e7cc-49ea-a2cf-68348fb87745 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:17.017254 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3d58acd2-e7cc-49ea-a2cf-68348fb87745 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:17.017685 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3d58acd2-e7cc-49ea-a2cf-68348fb87745 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:17.173726 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-3d58acd2-e7cc-49ea-a2cf-68348fb87745 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:17.182472 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-3d58acd2-e7cc-49ea-a2cf-68348fb87745 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2" status: 200 len: 1267 microversion: 2.1 time: 0.177012 Nov 15 12:45:17.183365 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 407/785] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:17 2021] GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:45:17.206708 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-254cc4d2-93ad-41fd-9cfd-bd515582422e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:17.207901 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-254cc4d2-93ad-41fd-9cfd-bd515582422e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:17.214657 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-254cc4d2-93ad-41fd-9cfd-bd515582422e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:17.215130 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-254cc4d2-93ad-41fd-9cfd-bd515582422e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:17.215917 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-254cc4d2-93ad-41fd-9cfd-bd515582422e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:17.216351 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-254cc4d2-93ad-41fd-9cfd-bd515582422e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:17.936234 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-254cc4d2-93ad-41fd-9cfd-bd515582422e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 14 microversion: 2.20 time: 0.733215 Nov 15 12:45:17.936934 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 408/786] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:17 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 14 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:45:17.959952 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-57c53bae-b78a-4817-b81e-289e00553259 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 14 microversion: 2.1 time: 1.814561 Nov 15 12:45:17.960603 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 379/787] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:16 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 14 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 15 12:45:17.966080 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-8c4bdb55-3ea1-4731-ba8f-8b4c0260d768 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:17.966801 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-8c4bdb55-3ea1-4731-ba8f-8b4c0260d768 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:17.975765 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8c4bdb55-3ea1-4731-ba8f-8b4c0260d768 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:17.976311 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8c4bdb55-3ea1-4731-ba8f-8b4c0260d768 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:17.977198 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8c4bdb55-3ea1-4731-ba8f-8b4c0260d768 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:17.977754 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8c4bdb55-3ea1-4731-ba8f-8b4c0260d768 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:18.077500 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [req-086e55d8-afb0-446f-9428-fbe57cbfb38c req-9d58406e-aa5a-4159-a9fb-8a2cd9420429 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12e0ab18-a841-4228-bebb-1c5d1db6f7f6", "tag": "ffefc1bf-d747-45f6-8979-9a984c11ed67"}]} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:18.079905 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:45:18.079905 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: warnings.warn(msg) Nov 15 12:45:18.089168 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-086e55d8-afb0-446f-9428-fbe57cbfb38c req-9d58406e-aa5a-4159-a9fb-8a2cd9420429 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:18.089870 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-086e55d8-afb0-446f-9428-fbe57cbfb38c req-9d58406e-aa5a-4159-a9fb-8a2cd9420429 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:18.102213 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.compute.server_external_events [req-086e55d8-afb0-446f-9428-fbe57cbfb38c req-9d58406e-aa5a-4159-a9fb-8a2cd9420429 service nova] Creating event network-changed:ffefc1bf-d747-45f6-8979-9a984c11ed67 for instance 12e0ab18-a841-4228-bebb-1c5d1db6f7f6 on hv-cinder-68088 Nov 15 12:45:18.108755 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [req-086e55d8-afb0-446f-9428-fbe57cbfb38c req-9d58406e-aa5a-4159-a9fb-8a2cd9420429 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170488 Nov 15 12:45:18.110144 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 409/788] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:45:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:45:18.134172 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-8c4bdb55-3ea1-4731-ba8f-8b4c0260d768 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:18.142544 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-8c4bdb55-3ea1-4731-ba8f-8b4c0260d768 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1570 microversion: 2.1 time: 0.180186 Nov 15 12:45:18.143582 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 380/789] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:17 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1570 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:18.199935 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-d16b36ee-c045-4aa2-9783-6627f8b19170 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:18.201208 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-d16b36ee-c045-4aa2-9783-6627f8b19170 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:18.218988 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d16b36ee-c045-4aa2-9783-6627f8b19170 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:18.219591 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d16b36ee-c045-4aa2-9783-6627f8b19170 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:18.220595 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d16b36ee-c045-4aa2-9783-6627f8b19170 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:18.221249 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d16b36ee-c045-4aa2-9783-6627f8b19170 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:18.476074 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-d16b36ee-c045-4aa2-9783-6627f8b19170 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:18.484262 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-d16b36ee-c045-4aa2-9783-6627f8b19170 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2" status: 200 len: 1267 microversion: 2.1 time: 0.288503 Nov 15 12:45:18.484982 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 410/790] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:18 2021] GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2 => generated 1267 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:18.947489 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-2bb89f08-404a-44e6-a9d3-5cd6a9bfe016 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:18.949951 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-2bb89f08-404a-44e6-a9d3-5cd6a9bfe016 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:18.956246 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2bb89f08-404a-44e6-a9d3-5cd6a9bfe016 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:18.956684 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2bb89f08-404a-44e6-a9d3-5cd6a9bfe016 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:18.957452 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2bb89f08-404a-44e6-a9d3-5cd6a9bfe016 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:18.957873 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2bb89f08-404a-44e6-a9d3-5cd6a9bfe016 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:18.969879 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e8c470ba-c546-4128-b840-2c746b40f145 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:18.970809 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e8c470ba-c546-4128-b840-2c746b40f145 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:18.977508 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e8c470ba-c546-4128-b840-2c746b40f145 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:18.977980 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e8c470ba-c546-4128-b840-2c746b40f145 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:18.978801 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e8c470ba-c546-4128-b840-2c746b40f145 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:18.979247 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e8c470ba-c546-4128-b840-2c746b40f145 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:19.060475 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-2bb89f08-404a-44e6-a9d3-5cd6a9bfe016 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 14 microversion: 2.20 time: 0.117051 Nov 15 12:45:19.061091 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 381/791] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:18 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:19.083227 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e8c470ba-c546-4128-b840-2c746b40f145 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 14 microversion: 2.1 time: 0.116735 Nov 15 12:45:19.083863 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 411/792] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:18 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 15 12:45:19.162730 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-45d6d96f-f697-40f4-abfb-64e6c55e1170 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:19.163562 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-45d6d96f-f697-40f4-abfb-64e6c55e1170 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:19.172512 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-45d6d96f-f697-40f4-abfb-64e6c55e1170 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:19.172959 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-45d6d96f-f697-40f4-abfb-64e6c55e1170 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:19.173743 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-45d6d96f-f697-40f4-abfb-64e6c55e1170 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:19.174221 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-45d6d96f-f697-40f4-abfb-64e6c55e1170 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:19.328058 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-45d6d96f-f697-40f4-abfb-64e6c55e1170 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:19.335640 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-45d6d96f-f697-40f4-abfb-64e6c55e1170 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1570 microversion: 2.1 time: 0.178024 Nov 15 12:45:19.336207 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 382/793] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:19 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1570 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:19.501794 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-0fe1bcd4-ae59-4ca7-a45d-483a02753691 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:19.502484 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-0fe1bcd4-ae59-4ca7-a45d-483a02753691 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:19.509389 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0fe1bcd4-ae59-4ca7-a45d-483a02753691 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:19.510489 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0fe1bcd4-ae59-4ca7-a45d-483a02753691 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:19.511310 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0fe1bcd4-ae59-4ca7-a45d-483a02753691 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:19.511759 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0fe1bcd4-ae59-4ca7-a45d-483a02753691 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:19.655735 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-0fe1bcd4-ae59-4ca7-a45d-483a02753691 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:19.663183 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-0fe1bcd4-ae59-4ca7-a45d-483a02753691 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2" status: 200 len: 1267 microversion: 2.1 time: 0.165409 Nov 15 12:45:19.663754 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 412/794] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:19 2021] GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:20.071415 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-363945fc-3ef4-4921-aa3e-43ef2f137076 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:20.073152 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-363945fc-3ef4-4921-aa3e-43ef2f137076 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:20.079116 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-363945fc-3ef4-4921-aa3e-43ef2f137076 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:20.079553 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-363945fc-3ef4-4921-aa3e-43ef2f137076 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:20.080321 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-363945fc-3ef4-4921-aa3e-43ef2f137076 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:20.080742 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-363945fc-3ef4-4921-aa3e-43ef2f137076 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:20.093429 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-7b9539e0-3d5d-4a22-a295-a0140bc0b9fd tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:20.094481 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-7b9539e0-3d5d-4a22-a295-a0140bc0b9fd tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:20.100942 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7b9539e0-3d5d-4a22-a295-a0140bc0b9fd tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:20.101393 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7b9539e0-3d5d-4a22-a295-a0140bc0b9fd tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:20.102176 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7b9539e0-3d5d-4a22-a295-a0140bc0b9fd tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:20.102616 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7b9539e0-3d5d-4a22-a295-a0140bc0b9fd tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:20.185553 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-363945fc-3ef4-4921-aa3e-43ef2f137076 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 14 microversion: 2.20 time: 0.117572 Nov 15 12:45:20.186191 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 383/795] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:20 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:20.218819 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-7b9539e0-3d5d-4a22-a295-a0140bc0b9fd tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 14 microversion: 2.1 time: 0.128828 Nov 15 12:45:20.219614 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 413/796] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:20 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 15 12:45:20.354442 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-bb03d93a-da55-4061-88e1-5c4ed20efbfd tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:20.355179 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-bb03d93a-da55-4061-88e1-5c4ed20efbfd tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:20.362520 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bb03d93a-da55-4061-88e1-5c4ed20efbfd tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:20.362988 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bb03d93a-da55-4061-88e1-5c4ed20efbfd tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:20.363879 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bb03d93a-da55-4061-88e1-5c4ed20efbfd tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:20.364214 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bb03d93a-da55-4061-88e1-5c4ed20efbfd tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:20.514307 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-bb03d93a-da55-4061-88e1-5c4ed20efbfd tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:20.521761 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-bb03d93a-da55-4061-88e1-5c4ed20efbfd tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1570 microversion: 2.1 time: 0.172044 Nov 15 12:45:20.522358 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 384/797] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:20 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1570 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:20.680584 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-9828eaa9-fa9b-42bf-a789-a194db45f1a9 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:20.681345 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-9828eaa9-fa9b-42bf-a789-a194db45f1a9 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:20.688382 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9828eaa9-fa9b-42bf-a789-a194db45f1a9 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:20.688825 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9828eaa9-fa9b-42bf-a789-a194db45f1a9 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:20.689609 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9828eaa9-fa9b-42bf-a789-a194db45f1a9 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:20.690033 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9828eaa9-fa9b-42bf-a789-a194db45f1a9 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:20.844651 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-9828eaa9-fa9b-42bf-a789-a194db45f1a9 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:20.851896 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-9828eaa9-fa9b-42bf-a789-a194db45f1a9 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2" status: 200 len: 1267 microversion: 2.1 time: 0.175383 Nov 15 12:45:20.852453 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 414/798] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:20 2021] GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:21.196255 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-ea6c3671-bb90-41b8-b617-8694c01d3782 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:21.197195 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-ea6c3671-bb90-41b8-b617-8694c01d3782 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:21.203712 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ea6c3671-bb90-41b8-b617-8694c01d3782 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:21.204152 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ea6c3671-bb90-41b8-b617-8694c01d3782 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:21.204928 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ea6c3671-bb90-41b8-b617-8694c01d3782 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:21.205351 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ea6c3671-bb90-41b8-b617-8694c01d3782 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:21.230926 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-0cd69846-e93e-4897-a4c4-0450b647a3fe tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:21.231845 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-0cd69846-e93e-4897-a4c4-0450b647a3fe tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:21.238409 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0cd69846-e93e-4897-a4c4-0450b647a3fe tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:21.238898 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0cd69846-e93e-4897-a4c4-0450b647a3fe tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:21.239701 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0cd69846-e93e-4897-a4c4-0450b647a3fe tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:21.240134 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0cd69846-e93e-4897-a4c4-0450b647a3fe tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:21.305133 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-ea6c3671-bb90-41b8-b617-8694c01d3782 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 14 microversion: 2.20 time: 0.112370 Nov 15 12:45:21.305772 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 385/799] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:21 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:21.328571 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-0cd69846-e93e-4897-a4c4-0450b647a3fe tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 14 microversion: 2.1 time: 0.102295 Nov 15 12:45:21.329209 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 415/800] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:21 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 15 12:45:21.540686 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-367bd858-94ae-4c5a-829d-7bc7ad580ff3 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:21.541956 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-367bd858-94ae-4c5a-829d-7bc7ad580ff3 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:21.549586 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-367bd858-94ae-4c5a-829d-7bc7ad580ff3 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:21.550039 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-367bd858-94ae-4c5a-829d-7bc7ad580ff3 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:21.550862 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-367bd858-94ae-4c5a-829d-7bc7ad580ff3 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:21.551310 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-367bd858-94ae-4c5a-829d-7bc7ad580ff3 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:21.696635 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-367bd858-94ae-4c5a-829d-7bc7ad580ff3 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:21.704941 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-367bd858-94ae-4c5a-829d-7bc7ad580ff3 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1570 microversion: 2.1 time: 0.168213 Nov 15 12:45:21.705506 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 386/801] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:21 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1570 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:21.869684 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-44877193-b9da-483f-9f8d-0432d69c4855 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:21.870595 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-44877193-b9da-483f-9f8d-0432d69c4855 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:21.878218 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-44877193-b9da-483f-9f8d-0432d69c4855 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:21.878841 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-44877193-b9da-483f-9f8d-0432d69c4855 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:21.879787 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-44877193-b9da-483f-9f8d-0432d69c4855 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:21.880227 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-44877193-b9da-483f-9f8d-0432d69c4855 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:22.026061 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-44877193-b9da-483f-9f8d-0432d69c4855 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:22.033563 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-44877193-b9da-483f-9f8d-0432d69c4855 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2" status: 200 len: 1267 microversion: 2.1 time: 0.167855 Nov 15 12:45:22.043536 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 416/802] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:21 2021] GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:22.316625 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-cec14324-8f35-4412-bf9c-6ba5967a536d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:22.317520 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-cec14324-8f35-4412-bf9c-6ba5967a536d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:22.324381 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-cec14324-8f35-4412-bf9c-6ba5967a536d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:22.324823 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-cec14324-8f35-4412-bf9c-6ba5967a536d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:22.325595 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-cec14324-8f35-4412-bf9c-6ba5967a536d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:22.326019 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-cec14324-8f35-4412-bf9c-6ba5967a536d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:22.341539 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-1068619e-7f70-4887-a6c1-d6e900043079 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:22.342478 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-1068619e-7f70-4887-a6c1-d6e900043079 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:22.349032 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1068619e-7f70-4887-a6c1-d6e900043079 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:22.349514 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1068619e-7f70-4887-a6c1-d6e900043079 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:22.350301 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1068619e-7f70-4887-a6c1-d6e900043079 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:22.350783 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1068619e-7f70-4887-a6c1-d6e900043079 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:22.428273 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-cec14324-8f35-4412-bf9c-6ba5967a536d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 14 microversion: 2.20 time: 0.115156 Nov 15 12:45:22.428903 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 387/803] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:22 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:22.454830 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-1068619e-7f70-4887-a6c1-d6e900043079 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 14 microversion: 2.1 time: 0.117604 Nov 15 12:45:22.455687 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 417/804] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:22 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 15 12:45:22.722998 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-665e6e64-5759-4fa8-b8d4-6e14cbe55d18 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:22.723692 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-665e6e64-5759-4fa8-b8d4-6e14cbe55d18 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:22.730711 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-665e6e64-5759-4fa8-b8d4-6e14cbe55d18 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:22.731174 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-665e6e64-5759-4fa8-b8d4-6e14cbe55d18 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:22.732355 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-665e6e64-5759-4fa8-b8d4-6e14cbe55d18 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:22.732962 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-665e6e64-5759-4fa8-b8d4-6e14cbe55d18 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:22.882369 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-665e6e64-5759-4fa8-b8d4-6e14cbe55d18 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:22.890591 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-665e6e64-5759-4fa8-b8d4-6e14cbe55d18 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1570 microversion: 2.1 time: 0.171516 Nov 15 12:45:22.891211 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 388/805] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:22 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1570 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:23.051812 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-c8828d27-6906-4fb0-a9fd-167da218d5f4 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:23.052514 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-c8828d27-6906-4fb0-a9fd-167da218d5f4 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:23.068084 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c8828d27-6906-4fb0-a9fd-167da218d5f4 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:23.068530 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c8828d27-6906-4fb0-a9fd-167da218d5f4 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:23.069321 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c8828d27-6906-4fb0-a9fd-167da218d5f4 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:23.069753 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c8828d27-6906-4fb0-a9fd-167da218d5f4 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:23.215540 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-c8828d27-6906-4fb0-a9fd-167da218d5f4 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:23.223161 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-c8828d27-6906-4fb0-a9fd-167da218d5f4 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2" status: 200 len: 1267 microversion: 2.1 time: 0.175741 Nov 15 12:45:23.223767 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 418/806] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:23 2021] GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:23.441800 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-1d921158-1772-44a3-b2d2-33e1e0a3d19d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:23.442917 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-1d921158-1772-44a3-b2d2-33e1e0a3d19d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:23.450622 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1d921158-1772-44a3-b2d2-33e1e0a3d19d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:23.451196 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1d921158-1772-44a3-b2d2-33e1e0a3d19d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:23.452816 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1d921158-1772-44a3-b2d2-33e1e0a3d19d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:23.453637 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1d921158-1772-44a3-b2d2-33e1e0a3d19d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:23.469793 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-85f96110-5a2f-4693-b1e2-49870935626a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:23.472293 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-85f96110-5a2f-4693-b1e2-49870935626a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:23.487002 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-85f96110-5a2f-4693-b1e2-49870935626a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:23.487803 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-85f96110-5a2f-4693-b1e2-49870935626a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:23.489197 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-85f96110-5a2f-4693-b1e2-49870935626a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:23.489974 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-85f96110-5a2f-4693-b1e2-49870935626a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:23.591012 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-1d921158-1772-44a3-b2d2-33e1e0a3d19d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 14 microversion: 2.20 time: 0.152704 Nov 15 12:45:23.591824 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 389/807] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:23 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:45:23.596541 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-6de6c8d7-f603-4931-9fe8-e9b636d7ae42 req-7972bf19-29a5-48ce-a7dc-715d175cb9db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2", "name": "network-vif-plugged", "status": "completed", "tag": "e4e6fc76-abc6-4e8a-8982-935e5e678851"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:23.598194 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:45:23.598194 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:45:23.606717 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-6de6c8d7-f603-4931-9fe8-e9b636d7ae42 req-7972bf19-29a5-48ce-a7dc-715d175cb9db service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:23.607198 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-6de6c8d7-f603-4931-9fe8-e9b636d7ae42 req-7972bf19-29a5-48ce-a7dc-715d175cb9db service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:23.615101 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-85f96110-5a2f-4693-b1e2-49870935626a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 14 microversion: 2.1 time: 0.152368 Nov 15 12:45:23.615743 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 419/808] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:23 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 15 12:45:23.618632 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-6de6c8d7-f603-4931-9fe8-e9b636d7ae42 req-7972bf19-29a5-48ce-a7dc-715d175cb9db service nova] Creating event network-vif-plugged:e4e6fc76-abc6-4e8a-8982-935e5e678851 for instance f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2 on hv-cinder-68088 Nov 15 12:45:23.624016 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-6de6c8d7-f603-4931-9fe8-e9b636d7ae42 req-7972bf19-29a5-48ce-a7dc-715d175cb9db service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031053 Nov 15 12:45:23.624595 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 390/809] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:45:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:45:23.908721 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-09bce3ed-ee68-4fe4-8142-b00386ed75ff tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:23.909426 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-09bce3ed-ee68-4fe4-8142-b00386ed75ff tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:23.916920 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-09bce3ed-ee68-4fe4-8142-b00386ed75ff tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:23.917372 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-09bce3ed-ee68-4fe4-8142-b00386ed75ff tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:23.918161 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-09bce3ed-ee68-4fe4-8142-b00386ed75ff tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:23.918592 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-09bce3ed-ee68-4fe4-8142-b00386ed75ff tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:24.064291 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-09bce3ed-ee68-4fe4-8142-b00386ed75ff tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:24.073729 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-09bce3ed-ee68-4fe4-8142-b00386ed75ff tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1570 microversion: 2.1 time: 0.169110 Nov 15 12:45:24.074379 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 420/810] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:23 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:24.242554 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-4cdb6d13-eff3-4f6e-9ded-a274a6e02af1 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:24.243268 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-4cdb6d13-eff3-4f6e-9ded-a274a6e02af1 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:24.250270 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4cdb6d13-eff3-4f6e-9ded-a274a6e02af1 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:24.250709 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4cdb6d13-eff3-4f6e-9ded-a274a6e02af1 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:24.251500 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4cdb6d13-eff3-4f6e-9ded-a274a6e02af1 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:24.251923 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4cdb6d13-eff3-4f6e-9ded-a274a6e02af1 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:24.390956 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-4cdb6d13-eff3-4f6e-9ded-a274a6e02af1 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:24.398281 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-4cdb6d13-eff3-4f6e-9ded-a274a6e02af1 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2" status: 200 len: 1267 microversion: 2.1 time: 0.160140 Nov 15 12:45:24.398863 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 391/811] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:24 2021] GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:24.601580 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-f85c21e6-4754-4a22-88af-338962e6285e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:24.602567 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-f85c21e6-4754-4a22-88af-338962e6285e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:24.609814 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f85c21e6-4754-4a22-88af-338962e6285e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:24.610185 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f85c21e6-4754-4a22-88af-338962e6285e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:24.610995 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f85c21e6-4754-4a22-88af-338962e6285e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:24.611426 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f85c21e6-4754-4a22-88af-338962e6285e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:24.627254 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-e444611b-d7f8-416c-811b-be75dc04728e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:24.628199 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-e444611b-d7f8-416c-811b-be75dc04728e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:24.636876 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e444611b-d7f8-416c-811b-be75dc04728e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:24.637474 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e444611b-d7f8-416c-811b-be75dc04728e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:24.638179 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e444611b-d7f8-416c-811b-be75dc04728e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:24.638610 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e444611b-d7f8-416c-811b-be75dc04728e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:24.737984 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-f85c21e6-4754-4a22-88af-338962e6285e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 14 microversion: 2.20 time: 0.139895 Nov 15 12:45:24.738668 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 421/812] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:24 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:24.765764 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-e444611b-d7f8-416c-811b-be75dc04728e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 14 microversion: 2.1 time: 0.142217 Nov 15 12:45:24.766395 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 392/813] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:24 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 15 12:45:25.091796 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-01cd7cca-2a42-4166-807d-d65b32304474 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:25.092567 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-01cd7cca-2a42-4166-807d-d65b32304474 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:25.099364 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-01cd7cca-2a42-4166-807d-d65b32304474 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:25.099816 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-01cd7cca-2a42-4166-807d-d65b32304474 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:25.100587 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-01cd7cca-2a42-4166-807d-d65b32304474 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:25.101020 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-01cd7cca-2a42-4166-807d-d65b32304474 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:25.250413 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-01cd7cca-2a42-4166-807d-d65b32304474 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:25.258028 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-01cd7cca-2a42-4166-807d-d65b32304474 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1570 microversion: 2.1 time: 0.170453 Nov 15 12:45:25.258588 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 422/814] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:25 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:25.415230 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-4b32e70d-230d-4a0d-bf5f-7c93d938824d tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:25.416726 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-4b32e70d-230d-4a0d-bf5f-7c93d938824d tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:25.423915 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4b32e70d-230d-4a0d-bf5f-7c93d938824d tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:25.424368 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4b32e70d-230d-4a0d-bf5f-7c93d938824d tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:25.425222 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4b32e70d-230d-4a0d-bf5f-7c93d938824d tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:25.425689 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4b32e70d-230d-4a0d-bf5f-7c93d938824d tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:25.573600 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-4b32e70d-230d-4a0d-bf5f-7c93d938824d tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:25.581612 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-4b32e70d-230d-4a0d-bf5f-7c93d938824d tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2" status: 200 len: 1455 microversion: 2.1 time: 0.169815 Nov 15 12:45:25.581612 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 393/815] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:25 2021] GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2 => generated 1455 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:25.597797 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-5176d0b1-3bc3-488c-83eb-94ee60700a49 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:25.598492 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-5176d0b1-3bc3-488c-83eb-94ee60700a49 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:25.605165 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5176d0b1-3bc3-488c-83eb-94ee60700a49 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:25.605931 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5176d0b1-3bc3-488c-83eb-94ee60700a49 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:25.606403 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5176d0b1-3bc3-488c-83eb-94ee60700a49 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:25.606869 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5176d0b1-3bc3-488c-83eb-94ee60700a49 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:25.746376 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-5176d0b1-3bc3-488c-83eb-94ee60700a49 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:25.749738 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-a007c788-146b-43de-8276-8b35d9d73ee2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:25.750735 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-a007c788-146b-43de-8276-8b35d9d73ee2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:25.754130 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-5176d0b1-3bc3-488c-83eb-94ee60700a49 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2" status: 200 len: 1455 microversion: 2.1 time: 0.160013 Nov 15 12:45:25.754707 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 423/816] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:25 2021] GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2 => generated 1455 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:25.757210 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a007c788-146b-43de-8276-8b35d9d73ee2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:25.757655 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a007c788-146b-43de-8276-8b35d9d73ee2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:25.758423 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a007c788-146b-43de-8276-8b35d9d73ee2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:25.758881 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a007c788-146b-43de-8276-8b35d9d73ee2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:25.777593 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e260098a-32cb-4780-949c-bfe3bbc5db39 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:25.778737 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e260098a-32cb-4780-949c-bfe3bbc5db39 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:25.785512 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e260098a-32cb-4780-949c-bfe3bbc5db39 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:25.786022 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e260098a-32cb-4780-949c-bfe3bbc5db39 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:25.786706 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e260098a-32cb-4780-949c-bfe3bbc5db39 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:25.787159 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e260098a-32cb-4780-949c-bfe3bbc5db39 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:25.892588 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-a007c788-146b-43de-8276-8b35d9d73ee2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 14 microversion: 2.20 time: 0.146264 Nov 15 12:45:25.895960 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 394/817] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:25 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:45:25.923570 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e260098a-32cb-4780-949c-bfe3bbc5db39 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 14 microversion: 2.1 time: 0.150470 Nov 15 12:45:25.924276 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 424/818] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:25 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 15 12:45:26.277018 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-971cf834-72ff-47c5-ad81-e218c079868b tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:26.277716 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-971cf834-72ff-47c5-ad81-e218c079868b tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:26.284661 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-971cf834-72ff-47c5-ad81-e218c079868b tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:26.285106 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-971cf834-72ff-47c5-ad81-e218c079868b tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:26.285895 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-971cf834-72ff-47c5-ad81-e218c079868b tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:26.286325 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-971cf834-72ff-47c5-ad81-e218c079868b tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:26.431013 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-971cf834-72ff-47c5-ad81-e218c079868b tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:26.439705 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-971cf834-72ff-47c5-ad81-e218c079868b tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1570 microversion: 2.1 time: 0.167013 Nov 15 12:45:26.440291 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 395/819] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:26 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:26.905204 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-3f1a2893-2c14-4ee7-b2eb-632dfa71986b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:26.906377 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-3f1a2893-2c14-4ee7-b2eb-632dfa71986b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:26.913776 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3f1a2893-2c14-4ee7-b2eb-632dfa71986b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:26.914236 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3f1a2893-2c14-4ee7-b2eb-632dfa71986b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:26.915073 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3f1a2893-2c14-4ee7-b2eb-632dfa71986b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:26.915620 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3f1a2893-2c14-4ee7-b2eb-632dfa71986b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:26.933736 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-a3e18766-7e57-46f0-b8aa-087538a3a382 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:26.935184 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-a3e18766-7e57-46f0-b8aa-087538a3a382 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:26.941409 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a3e18766-7e57-46f0-b8aa-087538a3a382 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:26.941990 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a3e18766-7e57-46f0-b8aa-087538a3a382 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:26.942941 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a3e18766-7e57-46f0-b8aa-087538a3a382 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:26.943613 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a3e18766-7e57-46f0-b8aa-087538a3a382 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:27.021724 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-3f1a2893-2c14-4ee7-b2eb-632dfa71986b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 14 microversion: 2.20 time: 0.121039 Nov 15 12:45:27.025777 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 425/820] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:26 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:27.075930 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-a3e18766-7e57-46f0-b8aa-087538a3a382 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 6451 microversion: 2.1 time: 0.145926 Nov 15 12:45:27.079274 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 396/821] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:26 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 6451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:45:27.457820 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-5fc87cf2-122a-4117-88e2-39deca7fbda3 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:27.458512 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-5fc87cf2-122a-4117-88e2-39deca7fbda3 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:27.465802 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5fc87cf2-122a-4117-88e2-39deca7fbda3 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:27.466212 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5fc87cf2-122a-4117-88e2-39deca7fbda3 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:27.467274 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5fc87cf2-122a-4117-88e2-39deca7fbda3 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:27.467922 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5fc87cf2-122a-4117-88e2-39deca7fbda3 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:27.623576 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-5fc87cf2-122a-4117-88e2-39deca7fbda3 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:27.631276 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-5fc87cf2-122a-4117-88e2-39deca7fbda3 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1570 microversion: 2.1 time: 0.177282 Nov 15 12:45:27.631718 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 426/822] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:27 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1570 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:27.851708 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-4704b534-a364-4b38-ac91-4508a216663e req-d79a0b01-ccc4-4f49-ac2f-67b6e4de651e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2", "tag": "e4e6fc76-abc6-4e8a-8982-935e5e678851"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:27.854457 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:45:27.854457 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:45:27.864640 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-4704b534-a364-4b38-ac91-4508a216663e req-d79a0b01-ccc4-4f49-ac2f-67b6e4de651e service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:27.865081 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-4704b534-a364-4b38-ac91-4508a216663e req-d79a0b01-ccc4-4f49-ac2f-67b6e4de651e service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:27.877985 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-4704b534-a364-4b38-ac91-4508a216663e req-d79a0b01-ccc4-4f49-ac2f-67b6e4de651e service nova] Creating event network-changed:e4e6fc76-abc6-4e8a-8982-935e5e678851 for instance f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2 on hv-cinder-68088 Nov 15 12:45:27.882925 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-4704b534-a364-4b38-ac91-4508a216663e req-d79a0b01-ccc4-4f49-ac2f-67b6e4de651e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035546 Nov 15 12:45:27.883611 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 397/823] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:45:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:45:28.033741 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-fdce6c1d-1625-4576-ad1b-5ad73edf387f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:28.034753 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-fdce6c1d-1625-4576-ad1b-5ad73edf387f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:28.042581 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-fdce6c1d-1625-4576-ad1b-5ad73edf387f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:28.043107 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-fdce6c1d-1625-4576-ad1b-5ad73edf387f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:28.043914 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-fdce6c1d-1625-4576-ad1b-5ad73edf387f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:28.044360 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-fdce6c1d-1625-4576-ad1b-5ad73edf387f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:28.088170 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-16394ff6-0fa4-46ff-8bc3-48e423b299b3 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:28.089629 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-16394ff6-0fa4-46ff-8bc3-48e423b299b3 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:28.096361 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-16394ff6-0fa4-46ff-8bc3-48e423b299b3 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:28.096808 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-16394ff6-0fa4-46ff-8bc3-48e423b299b3 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:28.097593 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-16394ff6-0fa4-46ff-8bc3-48e423b299b3 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:28.098022 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-16394ff6-0fa4-46ff-8bc3-48e423b299b3 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:28.151331 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-fdce6c1d-1625-4576-ad1b-5ad73edf387f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 14 microversion: 2.20 time: 0.120432 Nov 15 12:45:28.153006 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 427/824] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:28 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:28.242738 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-16394ff6-0fa4-46ff-8bc3-48e423b299b3 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 13887 microversion: 2.1 time: 0.159074 Nov 15 12:45:28.246726 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 398/825] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:28 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 13887 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:45:28.649235 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-3d74b04f-c20f-42c9-875a-f3b92458f31b tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:28.650899 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-3d74b04f-c20f-42c9-875a-f3b92458f31b tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:28.658432 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3d74b04f-c20f-42c9-875a-f3b92458f31b tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:28.659107 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3d74b04f-c20f-42c9-875a-f3b92458f31b tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:28.659957 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3d74b04f-c20f-42c9-875a-f3b92458f31b tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:28.660542 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3d74b04f-c20f-42c9-875a-f3b92458f31b tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:28.834297 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-3d74b04f-c20f-42c9-875a-f3b92458f31b tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:28.842511 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-3d74b04f-c20f-42c9-875a-f3b92458f31b tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1570 microversion: 2.1 time: 0.197780 Nov 15 12:45:28.843472 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 428/826] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:28 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1570 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:29.165275 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-4b80835e-1d2c-4c25-8c92-2177e02dce79 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:29.166886 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-4b80835e-1d2c-4c25-8c92-2177e02dce79 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:29.175879 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4b80835e-1d2c-4c25-8c92-2177e02dce79 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:29.176420 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4b80835e-1d2c-4c25-8c92-2177e02dce79 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:29.177243 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4b80835e-1d2c-4c25-8c92-2177e02dce79 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:29.177666 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4b80835e-1d2c-4c25-8c92-2177e02dce79 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:29.254529 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-f1cda398-6093-4acc-bb1f-64a8f19a0f7e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:29.255542 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-f1cda398-6093-4acc-bb1f-64a8f19a0f7e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:29.262686 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f1cda398-6093-4acc-bb1f-64a8f19a0f7e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:29.263169 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f1cda398-6093-4acc-bb1f-64a8f19a0f7e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:29.263965 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f1cda398-6093-4acc-bb1f-64a8f19a0f7e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:29.264396 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f1cda398-6093-4acc-bb1f-64a8f19a0f7e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:29.299928 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-4b80835e-1d2c-4c25-8c92-2177e02dce79 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 5834 microversion: 2.20 time: 0.138854 Nov 15 12:45:29.300768 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 399/827] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:29 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 5834 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:45:29.385258 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-f1cda398-6093-4acc-bb1f-64a8f19a0f7e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 17834 microversion: 2.1 time: 0.133955 Nov 15 12:45:29.385906 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 429/828] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:29 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 17834 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:45:29.860676 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-70463375-580a-4b4c-ab1f-ba906d57d494 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:29.861374 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-70463375-580a-4b4c-ab1f-ba906d57d494 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:29.868439 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-70463375-580a-4b4c-ab1f-ba906d57d494 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:29.869457 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-70463375-580a-4b4c-ab1f-ba906d57d494 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:29.870242 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-70463375-580a-4b4c-ab1f-ba906d57d494 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:29.870666 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-70463375-580a-4b4c-ab1f-ba906d57d494 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:30.012397 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-70463375-580a-4b4c-ab1f-ba906d57d494 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:30.021236 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-70463375-580a-4b4c-ab1f-ba906d57d494 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1570 microversion: 2.1 time: 0.164464 Nov 15 12:45:30.021811 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 400/829] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:29 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:30.312610 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-429a5a54-e342-4bd0-a2e7-0c7846de04c3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:30.313640 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-429a5a54-e342-4bd0-a2e7-0c7846de04c3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:30.320513 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-429a5a54-e342-4bd0-a2e7-0c7846de04c3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:30.320964 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-429a5a54-e342-4bd0-a2e7-0c7846de04c3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:30.321797 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-429a5a54-e342-4bd0-a2e7-0c7846de04c3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:30.323401 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-429a5a54-e342-4bd0-a2e7-0c7846de04c3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:30.396129 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-5973325c-693c-439c-bbed-34d8378d44aa tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:30.397033 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-5973325c-693c-439c-bbed-34d8378d44aa tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:30.403552 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5973325c-693c-439c-bbed-34d8378d44aa tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:30.403979 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5973325c-693c-439c-bbed-34d8378d44aa tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:30.404750 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5973325c-693c-439c-bbed-34d8378d44aa tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:30.405194 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5973325c-693c-439c-bbed-34d8378d44aa tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:30.429078 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-429a5a54-e342-4bd0-a2e7-0c7846de04c3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 11683 microversion: 2.20 time: 0.120361 Nov 15 12:45:30.429943 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 430/830] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:30 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 11683 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:45:30.527873 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-5973325c-693c-439c-bbed-34d8378d44aa tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 17960 microversion: 2.1 time: 0.135084 Nov 15 12:45:30.527873 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 401/831] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:30 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 17960 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:45:31.038388 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-5f5137d3-4dcb-4cff-8d00-ed9516989bf6 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:31.039119 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-5f5137d3-4dcb-4cff-8d00-ed9516989bf6 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:31.047374 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5f5137d3-4dcb-4cff-8d00-ed9516989bf6 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:31.047979 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5f5137d3-4dcb-4cff-8d00-ed9516989bf6 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:31.048797 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5f5137d3-4dcb-4cff-8d00-ed9516989bf6 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:31.049236 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5f5137d3-4dcb-4cff-8d00-ed9516989bf6 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:31.190896 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-5f5137d3-4dcb-4cff-8d00-ed9516989bf6 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:31.198519 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-5f5137d3-4dcb-4cff-8d00-ed9516989bf6 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1570 microversion: 2.1 time: 0.164183 Nov 15 12:45:31.199201 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 431/832] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:31 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:31.443159 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-8f2c60f8-9b1d-43ba-bba5-7f8a519329bb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:31.444152 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-8f2c60f8-9b1d-43ba-bba5-7f8a519329bb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:31.452047 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8f2c60f8-9b1d-43ba-bba5-7f8a519329bb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:31.452504 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8f2c60f8-9b1d-43ba-bba5-7f8a519329bb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:31.453318 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8f2c60f8-9b1d-43ba-bba5-7f8a519329bb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:31.453750 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8f2c60f8-9b1d-43ba-bba5-7f8a519329bb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:31.539390 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-fd32bc5e-30d3-4898-bb75-a78bf221342f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:31.540320 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-fd32bc5e-30d3-4898-bb75-a78bf221342f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:31.547856 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-fd32bc5e-30d3-4898-bb75-a78bf221342f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:31.548303 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-fd32bc5e-30d3-4898-bb75-a78bf221342f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:31.549085 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-fd32bc5e-30d3-4898-bb75-a78bf221342f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:31.549520 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-fd32bc5e-30d3-4898-bb75-a78bf221342f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:31.582414 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-8f2c60f8-9b1d-43ba-bba5-7f8a519329bb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 16403 microversion: 2.20 time: 0.144506 Nov 15 12:45:31.583227 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 402/833] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:31 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 16403 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:45:31.667432 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-fd32bc5e-30d3-4898-bb75-a78bf221342f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 20195 microversion: 2.1 time: 0.131212 Nov 15 12:45:31.668429 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 432/834] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:31 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 20195 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:45:32.216262 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-a8592f83-b77b-447e-b613-177951b7be02 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:32.216950 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-a8592f83-b77b-447e-b613-177951b7be02 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:32.223859 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a8592f83-b77b-447e-b613-177951b7be02 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:32.224302 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a8592f83-b77b-447e-b613-177951b7be02 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:32.225083 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a8592f83-b77b-447e-b613-177951b7be02 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:32.225510 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a8592f83-b77b-447e-b613-177951b7be02 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:32.365163 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-a8592f83-b77b-447e-b613-177951b7be02 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:32.374041 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-a8592f83-b77b-447e-b613-177951b7be02 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1511 microversion: 2.1 time: 0.161939 Nov 15 12:45:32.374814 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 403/835] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:32 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:32.391808 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-47b62ab7-83df-4dbc-bc19-51001ed1ed45 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:32.392457 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-47b62ab7-83df-4dbc-bc19-51001ed1ed45 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:32.399323 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-47b62ab7-83df-4dbc-bc19-51001ed1ed45 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:32.399769 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-47b62ab7-83df-4dbc-bc19-51001ed1ed45 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:32.400535 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-47b62ab7-83df-4dbc-bc19-51001ed1ed45 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:32.400965 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-47b62ab7-83df-4dbc-bc19-51001ed1ed45 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:32.505787 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-47b62ab7-83df-4dbc-bc19-51001ed1ed45 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "POST /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe/action" status: 202 len: 0 microversion: 2.1 time: 0.118013 Nov 15 12:45:32.506390 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 433/836] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:32 2021] POST /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:45:32.514632 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-63046592-dee8-432c-80a2-eac79d4d60e4 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:32.515262 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-63046592-dee8-432c-80a2-eac79d4d60e4 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:32.521844 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-63046592-dee8-432c-80a2-eac79d4d60e4 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:32.522292 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-63046592-dee8-432c-80a2-eac79d4d60e4 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:32.525424 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-63046592-dee8-432c-80a2-eac79d4d60e4 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:32.525875 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-63046592-dee8-432c-80a2-eac79d4d60e4 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:32.598072 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-08cd9786-0b9a-40e5-9750-280f1d217d1a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:32.599990 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-08cd9786-0b9a-40e5-9750-280f1d217d1a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:32.608633 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-08cd9786-0b9a-40e5-9750-280f1d217d1a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:32.613708 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-08cd9786-0b9a-40e5-9750-280f1d217d1a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:32.615274 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-08cd9786-0b9a-40e5-9750-280f1d217d1a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:32.621659 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-08cd9786-0b9a-40e5-9750-280f1d217d1a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:32.702144 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-63046592-dee8-432c-80a2-eac79d4d60e4 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:32.709876 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-63046592-dee8-432c-80a2-eac79d4d60e4 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1519 microversion: 2.1 time: 0.199049 Nov 15 12:45:32.710451 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 404/837] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:32 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1519 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:32.715814 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-419f0165-630a-4a1f-bb24-2ee5c2e3127a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:32.716711 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-419f0165-630a-4a1f-bb24-2ee5c2e3127a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:32.722560 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-419f0165-630a-4a1f-bb24-2ee5c2e3127a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:32.723044 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-419f0165-630a-4a1f-bb24-2ee5c2e3127a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:32.723970 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-419f0165-630a-4a1f-bb24-2ee5c2e3127a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:32.724247 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-419f0165-630a-4a1f-bb24-2ee5c2e3127a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:32.733015 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-08cd9786-0b9a-40e5-9750-280f1d217d1a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 17960 microversion: 2.20 time: 0.142456 Nov 15 12:45:32.733728 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 434/838] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:32 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 17960 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 15 12:45:32.841072 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-419f0165-630a-4a1f-bb24-2ee5c2e3127a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 22540 microversion: 2.1 time: 0.128517 Nov 15 12:45:32.841746 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 405/839] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:32 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 22540 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:45:33.729152 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-86f7ea40-910b-407d-9fec-460bce402c5f tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:33.729841 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-86f7ea40-910b-407d-9fec-460bce402c5f tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:33.736840 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-86f7ea40-910b-407d-9fec-460bce402c5f tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:33.737289 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-86f7ea40-910b-407d-9fec-460bce402c5f tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:33.738113 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-86f7ea40-910b-407d-9fec-460bce402c5f tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:33.738562 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-86f7ea40-910b-407d-9fec-460bce402c5f tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:33.745836 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-ee9b6fa1-bbdc-49e8-af6c-d38a96f9d791 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:33.748442 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-ee9b6fa1-bbdc-49e8-af6c-d38a96f9d791 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:33.757099 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ee9b6fa1-bbdc-49e8-af6c-d38a96f9d791 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:33.757545 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ee9b6fa1-bbdc-49e8-af6c-d38a96f9d791 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:33.758346 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ee9b6fa1-bbdc-49e8-af6c-d38a96f9d791 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:33.758795 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ee9b6fa1-bbdc-49e8-af6c-d38a96f9d791 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:33.888449 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-86f7ea40-910b-407d-9fec-460bce402c5f tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:33.894652 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-ee9b6fa1-bbdc-49e8-af6c-d38a96f9d791 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 19342 microversion: 2.20 time: 0.152699 Nov 15 12:45:33.896069 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 406/840] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:33 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 19342 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 15 12:45:33.896442 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-86f7ea40-910b-407d-9fec-460bce402c5f tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1521 microversion: 2.1 time: 0.171682 Nov 15 12:45:33.897617 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 435/841] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:33 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:33.907741 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-e02d4ca0-a5b8-4f17-8b81-19f0d876a23c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:33.908836 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-e02d4ca0-a5b8-4f17-8b81-19f0d876a23c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:33.917935 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e02d4ca0-a5b8-4f17-8b81-19f0d876a23c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:33.917935 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e02d4ca0-a5b8-4f17-8b81-19f0d876a23c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:33.917935 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e02d4ca0-a5b8-4f17-8b81-19f0d876a23c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:33.918322 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e02d4ca0-a5b8-4f17-8b81-19f0d876a23c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:34.026246 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-e02d4ca0-a5b8-4f17-8b81-19f0d876a23c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 23223 microversion: 2.1 time: 0.122236 Nov 15 12:45:34.027094 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 407/842] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:33 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 23223 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:45:34.907281 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-7902ab4c-c6a6-47ed-96b7-14d66ecfddb2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:34.908196 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-7902ab4c-c6a6-47ed-96b7-14d66ecfddb2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:34.914660 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7902ab4c-c6a6-47ed-96b7-14d66ecfddb2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:34.915143 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7902ab4c-c6a6-47ed-96b7-14d66ecfddb2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:34.915515 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-1a542061-bb5b-43b7-8cc0-cfd74be083c8 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:34.915965 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7902ab4c-c6a6-47ed-96b7-14d66ecfddb2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:34.916210 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-1a542061-bb5b-43b7-8cc0-cfd74be083c8 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:34.916320 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7902ab4c-c6a6-47ed-96b7-14d66ecfddb2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:34.925115 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1a542061-bb5b-43b7-8cc0-cfd74be083c8 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:34.926014 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1a542061-bb5b-43b7-8cc0-cfd74be083c8 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:34.927378 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1a542061-bb5b-43b7-8cc0-cfd74be083c8 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:34.928075 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1a542061-bb5b-43b7-8cc0-cfd74be083c8 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:35.037140 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-7902ab4c-c6a6-47ed-96b7-14d66ecfddb2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 21840 microversion: 2.20 time: 0.134188 Nov 15 12:45:35.040934 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 436/843] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:34 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 21840 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:45:35.043897 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-28cd3647-cfe1-4cbc-b4f2-ddd1067d56f8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:35.045390 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-28cd3647-cfe1-4cbc-b4f2-ddd1067d56f8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:35.053342 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-28cd3647-cfe1-4cbc-b4f2-ddd1067d56f8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:35.053792 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-28cd3647-cfe1-4cbc-b4f2-ddd1067d56f8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:35.054613 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-28cd3647-cfe1-4cbc-b4f2-ddd1067d56f8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:35.055082 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-28cd3647-cfe1-4cbc-b4f2-ddd1067d56f8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:35.081116 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-1a542061-bb5b-43b7-8cc0-cfd74be083c8 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:35.088673 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-1a542061-bb5b-43b7-8cc0-cfd74be083c8 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1577 microversion: 2.1 time: 0.177113 Nov 15 12:45:35.089239 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 408/844] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:34 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:35.177982 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-28cd3647-cfe1-4cbc-b4f2-ddd1067d56f8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 24489 microversion: 2.1 time: 0.138800 Nov 15 12:45:35.178867 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 437/845] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:35 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 24489 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:45:35.575563 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-2dd22cf7-4c95-4793-b1ff-1f70afe06c9b req-cf436ba0-08e2-4a82-a69c-532566c46398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a56962f0-d8f9-4778-a21e-1f2bc81789fe", "name": "network-vif-unplugged", "status": "completed", "tag": "5e3438d8-9d94-405a-af06-a2bd0727491d"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:35.577163 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:45:35.577163 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:45:35.585320 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-2dd22cf7-4c95-4793-b1ff-1f70afe06c9b req-cf436ba0-08e2-4a82-a69c-532566c46398 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:35.585757 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-2dd22cf7-4c95-4793-b1ff-1f70afe06c9b req-cf436ba0-08e2-4a82-a69c-532566c46398 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:35.596886 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-2dd22cf7-4c95-4793-b1ff-1f70afe06c9b req-cf436ba0-08e2-4a82-a69c-532566c46398 service nova] Creating event network-vif-unplugged:5e3438d8-9d94-405a-af06-a2bd0727491d for instance a56962f0-d8f9-4778-a21e-1f2bc81789fe on hv-cinder-68088 Nov 15 12:45:35.601656 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-2dd22cf7-4c95-4793-b1ff-1f70afe06c9b req-cf436ba0-08e2-4a82-a69c-532566c46398 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095306 Nov 15 12:45:35.602244 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 409/846] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:45:35 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:45:36.049229 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-5adfda71-23c0-4441-bcff-43c9f58f043e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:36.050230 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-5adfda71-23c0-4441-bcff-43c9f58f043e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:36.057190 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5adfda71-23c0-4441-bcff-43c9f58f043e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:36.057636 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5adfda71-23c0-4441-bcff-43c9f58f043e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:36.058415 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5adfda71-23c0-4441-bcff-43c9f58f043e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:36.058876 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5adfda71-23c0-4441-bcff-43c9f58f043e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:36.107569 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-fe6a017c-c826-4953-9647-061b8337caca tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:36.108397 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-fe6a017c-c826-4953-9647-061b8337caca tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:36.114720 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fe6a017c-c826-4953-9647-061b8337caca tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:36.115214 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fe6a017c-c826-4953-9647-061b8337caca tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:36.115957 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fe6a017c-c826-4953-9647-061b8337caca tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:36.116378 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fe6a017c-c826-4953-9647-061b8337caca tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:36.168297 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-5adfda71-23c0-4441-bcff-43c9f58f043e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 23045 microversion: 2.20 time: 0.123207 Nov 15 12:45:36.169593 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 438/847] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:36 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 23045 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:45:36.189891 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-ff190ec7-37cb-4b13-b3bd-8d3eb2a9e973 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:36.190941 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-ff190ec7-37cb-4b13-b3bd-8d3eb2a9e973 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:36.197856 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ff190ec7-37cb-4b13-b3bd-8d3eb2a9e973 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:36.198306 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ff190ec7-37cb-4b13-b3bd-8d3eb2a9e973 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:36.199117 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ff190ec7-37cb-4b13-b3bd-8d3eb2a9e973 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:36.199536 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ff190ec7-37cb-4b13-b3bd-8d3eb2a9e973 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:36.251974 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-fe6a017c-c826-4953-9647-061b8337caca tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:36.259193 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-fe6a017c-c826-4953-9647-061b8337caca tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1577 microversion: 2.1 time: 0.156803 Nov 15 12:45:36.259759 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 410/848] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:36 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:45:36.314924 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-ff190ec7-37cb-4b13-b3bd-8d3eb2a9e973 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 25841 microversion: 2.1 time: 0.128797 Nov 15 12:45:36.315582 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 439/849] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:36 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 25841 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:45:37.181529 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-caa30aa9-6c57-4e9d-8be1-4ddb2ce8977b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:37.182436 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-caa30aa9-6c57-4e9d-8be1-4ddb2ce8977b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:37.188726 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-caa30aa9-6c57-4e9d-8be1-4ddb2ce8977b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:37.189168 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-caa30aa9-6c57-4e9d-8be1-4ddb2ce8977b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:37.189930 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-caa30aa9-6c57-4e9d-8be1-4ddb2ce8977b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:37.190355 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-caa30aa9-6c57-4e9d-8be1-4ddb2ce8977b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:37.276692 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e03f8565-0aa9-4792-9f08-46c5bff1f959 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:37.277377 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e03f8565-0aa9-4792-9f08-46c5bff1f959 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:37.285107 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e03f8565-0aa9-4792-9f08-46c5bff1f959 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:37.285547 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e03f8565-0aa9-4792-9f08-46c5bff1f959 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:37.286320 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e03f8565-0aa9-4792-9f08-46c5bff1f959 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:37.286750 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e03f8565-0aa9-4792-9f08-46c5bff1f959 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:37.303139 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-caa30aa9-6c57-4e9d-8be1-4ddb2ce8977b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 24465 microversion: 2.20 time: 0.125068 Nov 15 12:45:37.303818 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 411/850] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:37 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 24465 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:45:37.326602 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-68a215be-ea66-4a88-8c3a-c412bdbb8287 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:37.327618 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-68a215be-ea66-4a88-8c3a-c412bdbb8287 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:37.334470 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-68a215be-ea66-4a88-8c3a-c412bdbb8287 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:37.334961 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-68a215be-ea66-4a88-8c3a-c412bdbb8287 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:37.335735 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-68a215be-ea66-4a88-8c3a-c412bdbb8287 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:37.336160 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-68a215be-ea66-4a88-8c3a-c412bdbb8287 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:37.423723 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e03f8565-0aa9-4792-9f08-46c5bff1f959 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:37.431101 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e03f8565-0aa9-4792-9f08-46c5bff1f959 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1577 microversion: 2.1 time: 0.158396 Nov 15 12:45:37.431735 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 440/851] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:37 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:45:37.444661 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-68a215be-ea66-4a88-8c3a-c412bdbb8287 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 26798 microversion: 2.1 time: 0.122445 Nov 15 12:45:37.445505 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 412/852] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:37 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 26798 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:45:38.316205 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-2dd7ae63-24bf-4dc0-91d2-2533056b81f3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:38.317301 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-2dd7ae63-24bf-4dc0-91d2-2533056b81f3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:38.323587 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2dd7ae63-24bf-4dc0-91d2-2533056b81f3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:38.324193 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2dd7ae63-24bf-4dc0-91d2-2533056b81f3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:38.325491 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2dd7ae63-24bf-4dc0-91d2-2533056b81f3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:38.325960 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2dd7ae63-24bf-4dc0-91d2-2533056b81f3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:38.435263 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-2dd7ae63-24bf-4dc0-91d2-2533056b81f3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 25412 microversion: 2.20 time: 0.122658 Nov 15 12:45:38.435831 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 441/853] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:38 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 25412 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:45:38.447904 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-a70df985-1663-4339-accd-326ad5c18076 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:38.448599 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-a70df985-1663-4339-accd-326ad5c18076 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:38.456542 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a70df985-1663-4339-accd-326ad5c18076 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:38.456984 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a70df985-1663-4339-accd-326ad5c18076 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:38.457651 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-cedacbfe-1719-4f4e-a8e0-ffb541c50e41 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:38.457772 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a70df985-1663-4339-accd-326ad5c18076 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:38.458186 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a70df985-1663-4339-accd-326ad5c18076 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:38.458711 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-cedacbfe-1719-4f4e-a8e0-ffb541c50e41 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:38.465690 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cedacbfe-1719-4f4e-a8e0-ffb541c50e41 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:38.466210 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cedacbfe-1719-4f4e-a8e0-ffb541c50e41 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:38.467030 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cedacbfe-1719-4f4e-a8e0-ffb541c50e41 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:38.467463 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cedacbfe-1719-4f4e-a8e0-ffb541c50e41 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:38.575463 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-cedacbfe-1719-4f4e-a8e0-ffb541c50e41 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 27382 microversion: 2.1 time: 0.120969 Nov 15 12:45:38.576381 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 442/854] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:38 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 27382 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:45:38.598083 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-a70df985-1663-4339-accd-326ad5c18076 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:38.605598 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-a70df985-1663-4339-accd-326ad5c18076 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1577 microversion: 2.1 time: 0.161614 Nov 15 12:45:38.606191 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 413/855] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:38 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:39.447334 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-839ce4e0-6b53-474b-9571-01252864c403 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:39.448307 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-839ce4e0-6b53-474b-9571-01252864c403 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:39.455635 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-839ce4e0-6b53-474b-9571-01252864c403 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:39.456000 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-839ce4e0-6b53-474b-9571-01252864c403 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:39.456763 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-839ce4e0-6b53-474b-9571-01252864c403 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:39.457184 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-839ce4e0-6b53-474b-9571-01252864c403 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:39.559078 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-839ce4e0-6b53-474b-9571-01252864c403 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 26362 microversion: 2.20 time: 0.115559 Nov 15 12:45:39.560303 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 443/856] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:39 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 26362 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:45:39.586519 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-5f2625c5-4e45-4583-9547-e8258840f313 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:39.587449 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-5f2625c5-4e45-4583-9547-e8258840f313 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:39.594379 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5f2625c5-4e45-4583-9547-e8258840f313 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:39.594853 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5f2625c5-4e45-4583-9547-e8258840f313 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:39.595621 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5f2625c5-4e45-4583-9547-e8258840f313 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:39.596048 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5f2625c5-4e45-4583-9547-e8258840f313 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:39.623028 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-8e1124de-8a68-4f54-b2d2-e8a4df2f95cb tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:39.623846 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-8e1124de-8a68-4f54-b2d2-e8a4df2f95cb tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:39.630667 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8e1124de-8a68-4f54-b2d2-e8a4df2f95cb tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:39.631128 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8e1124de-8a68-4f54-b2d2-e8a4df2f95cb tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:39.631897 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8e1124de-8a68-4f54-b2d2-e8a4df2f95cb tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:39.632327 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8e1124de-8a68-4f54-b2d2-e8a4df2f95cb tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:39.704726 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-5f2625c5-4e45-4583-9547-e8258840f313 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 27812 microversion: 2.1 time: 0.121651 Nov 15 12:45:39.708973 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 414/857] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:39 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 27812 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:45:39.766160 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-8e1124de-8a68-4f54-b2d2-e8a4df2f95cb tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:39.773578 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-8e1124de-8a68-4f54-b2d2-e8a4df2f95cb tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1577 microversion: 2.1 time: 0.154552 Nov 15 12:45:39.774147 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 444/858] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:39 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:45:40.572941 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-5730e53c-1e05-4ebc-a3a4-df9862674725 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:40.573982 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-5730e53c-1e05-4ebc-a3a4-df9862674725 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:40.583708 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5730e53c-1e05-4ebc-a3a4-df9862674725 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:40.584153 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5730e53c-1e05-4ebc-a3a4-df9862674725 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:40.585003 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5730e53c-1e05-4ebc-a3a4-df9862674725 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:40.585485 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5730e53c-1e05-4ebc-a3a4-df9862674725 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:40.706485 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-5730e53c-1e05-4ebc-a3a4-df9862674725 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 27139 microversion: 2.20 time: 0.138339 Nov 15 12:45:40.707255 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 415/859] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:40 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 27139 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:45:40.717130 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-d49a9ac4-58a7-4777-964e-c41d49e110f7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:40.718053 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-d49a9ac4-58a7-4777-964e-c41d49e110f7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:40.724491 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d49a9ac4-58a7-4777-964e-c41d49e110f7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:40.724934 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d49a9ac4-58a7-4777-964e-c41d49e110f7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:40.725712 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d49a9ac4-58a7-4777-964e-c41d49e110f7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:40.726136 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d49a9ac4-58a7-4777-964e-c41d49e110f7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:40.791598 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-53eb7426-07ab-45e7-ab0a-9967ae03c058 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:40.792300 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-53eb7426-07ab-45e7-ab0a-9967ae03c058 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:40.800663 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-53eb7426-07ab-45e7-ab0a-9967ae03c058 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:40.801109 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-53eb7426-07ab-45e7-ab0a-9967ae03c058 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:40.801884 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-53eb7426-07ab-45e7-ab0a-9967ae03c058 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:40.802320 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-53eb7426-07ab-45e7-ab0a-9967ae03c058 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:40.835490 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-d49a9ac4-58a7-4777-964e-c41d49e110f7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 28221 microversion: 2.1 time: 0.122535 Nov 15 12:45:40.836150 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 445/860] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:40 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 28221 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:45:40.952050 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-53eb7426-07ab-45e7-ab0a-9967ae03c058 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:40.959788 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-53eb7426-07ab-45e7-ab0a-9967ae03c058 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1577 microversion: 2.1 time: 0.172151 Nov 15 12:45:40.960563 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 416/861] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:40 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:45:41.719234 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e1adfffb-296d-4bc8-9320-7fac38dcbd3e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:41.720244 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e1adfffb-296d-4bc8-9320-7fac38dcbd3e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:41.727028 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e1adfffb-296d-4bc8-9320-7fac38dcbd3e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:41.727473 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e1adfffb-296d-4bc8-9320-7fac38dcbd3e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:41.728240 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e1adfffb-296d-4bc8-9320-7fac38dcbd3e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:41.728669 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e1adfffb-296d-4bc8-9320-7fac38dcbd3e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:41.847211 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-bf27d3ec-e4f2-4aaa-9916-2d982cce4392 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:41.848219 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-bf27d3ec-e4f2-4aaa-9916-2d982cce4392 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:41.854453 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bf27d3ec-e4f2-4aaa-9916-2d982cce4392 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:41.854935 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bf27d3ec-e4f2-4aaa-9916-2d982cce4392 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:41.855710 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bf27d3ec-e4f2-4aaa-9916-2d982cce4392 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:41.857272 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bf27d3ec-e4f2-4aaa-9916-2d982cce4392 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:42.000540 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e1adfffb-296d-4bc8-9320-7fac38dcbd3e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 27798 microversion: 2.20 time: 0.285218 Nov 15 12:45:42.001199 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 446/862] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:41 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 27798 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:45:42.006043 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-3d4b5b58-8c66-4c5e-abda-7ffcd6d3bb4e tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:42.006753 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-3d4b5b58-8c66-4c5e-abda-7ffcd6d3bb4e tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:42.013770 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3d4b5b58-8c66-4c5e-abda-7ffcd6d3bb4e tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:42.014232 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3d4b5b58-8c66-4c5e-abda-7ffcd6d3bb4e tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:42.015071 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3d4b5b58-8c66-4c5e-abda-7ffcd6d3bb4e tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:42.015506 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3d4b5b58-8c66-4c5e-abda-7ffcd6d3bb4e tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:42.018438 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-bf27d3ec-e4f2-4aaa-9916-2d982cce4392 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 28221 microversion: 2.1 time: 0.174759 Nov 15 12:45:42.019337 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 417/863] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:41 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 28221 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:45:42.147191 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-3d4b5b58-8c66-4c5e-abda-7ffcd6d3bb4e tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:42.155861 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-3d4b5b58-8c66-4c5e-abda-7ffcd6d3bb4e tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1577 microversion: 2.1 time: 0.153582 Nov 15 12:45:42.156475 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 447/864] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:42 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:43.013513 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-08f3de57-6c0c-4e93-8741-4705366511df tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:43.014493 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-08f3de57-6c0c-4e93-8741-4705366511df tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:43.021314 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-08f3de57-6c0c-4e93-8741-4705366511df tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:43.021746 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-08f3de57-6c0c-4e93-8741-4705366511df tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:43.022510 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-08f3de57-6c0c-4e93-8741-4705366511df tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:43.022960 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-08f3de57-6c0c-4e93-8741-4705366511df tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:43.029240 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e92233b7-8d3f-4ccd-a561-6c8804e898c9 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:43.030147 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e92233b7-8d3f-4ccd-a561-6c8804e898c9 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:43.036484 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e92233b7-8d3f-4ccd-a561-6c8804e898c9 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:43.036928 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e92233b7-8d3f-4ccd-a561-6c8804e898c9 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:43.037699 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e92233b7-8d3f-4ccd-a561-6c8804e898c9 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:43.038126 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e92233b7-8d3f-4ccd-a561-6c8804e898c9 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:43.143552 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-08f3de57-6c0c-4e93-8741-4705366511df tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 28076 microversion: 2.20 time: 0.134524 Nov 15 12:45:43.144196 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 418/865] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:43 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 28076 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:45:43.162631 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e92233b7-8d3f-4ccd-a561-6c8804e898c9 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 28221 microversion: 2.1 time: 0.136727 Nov 15 12:45:43.163235 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 448/866] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:43 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 28221 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:45:43.173163 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-a2e0e8ef-dcef-44a4-82b7-ae87434e1d94 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:45:43.173847 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-a2e0e8ef-dcef-44a4-82b7-ae87434e1d94 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:43.180658 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a2e0e8ef-dcef-44a4-82b7-ae87434e1d94 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:43.181104 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a2e0e8ef-dcef-44a4-82b7-ae87434e1d94 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:43.181865 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a2e0e8ef-dcef-44a4-82b7-ae87434e1d94 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:43.182288 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a2e0e8ef-dcef-44a4-82b7-ae87434e1d94 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:43.315870 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-a2e0e8ef-dcef-44a4-82b7-ae87434e1d94 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:45:43.323226 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-a2e0e8ef-dcef-44a4-82b7-ae87434e1d94 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1564 microversion: 2.1 time: 0.154243 Nov 15 12:45:43.323791 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 419/867] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:45:43 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:45:44.156355 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-24a61360-450c-41d3-a615-b2f39a9ceace tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:44.157441 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-24a61360-450c-41d3-a615-b2f39a9ceace tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:44.164743 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-24a61360-450c-41d3-a615-b2f39a9ceace tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:44.165265 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-24a61360-450c-41d3-a615-b2f39a9ceace tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:44.166049 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-24a61360-450c-41d3-a615-b2f39a9ceace tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:44.166491 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-24a61360-450c-41d3-a615-b2f39a9ceace tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:44.175122 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-83168f68-9321-4303-9149-3cc5924207f0 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:44.177388 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-83168f68-9321-4303-9149-3cc5924207f0 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:44.183408 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-83168f68-9321-4303-9149-3cc5924207f0 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:44.184249 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-83168f68-9321-4303-9149-3cc5924207f0 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:44.185109 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-83168f68-9321-4303-9149-3cc5924207f0 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:44.185604 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-83168f68-9321-4303-9149-3cc5924207f0 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:44.298864 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-24a61360-450c-41d3-a615-b2f39a9ceace tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 28203 microversion: 2.20 time: 0.147331 Nov 15 12:45:44.299690 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 449/868] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:44 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 28203 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:45:44.333570 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-83168f68-9321-4303-9149-3cc5924207f0 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 28221 microversion: 2.1 time: 0.162073 Nov 15 12:45:44.334224 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 420/869] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:44 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 28221 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:45:45.310447 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-35446672-84ac-4d11-a84f-0e38dfe5859d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:45.311360 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-35446672-84ac-4d11-a84f-0e38dfe5859d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:45.318202 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-35446672-84ac-4d11-a84f-0e38dfe5859d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:45.318644 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-35446672-84ac-4d11-a84f-0e38dfe5859d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:45.319445 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-35446672-84ac-4d11-a84f-0e38dfe5859d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:45.319870 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-35446672-84ac-4d11-a84f-0e38dfe5859d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:45.346289 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-1181ef3a-7a82-449f-a137-92101309bd1e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:45.347283 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-1181ef3a-7a82-449f-a137-92101309bd1e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:45.354116 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1181ef3a-7a82-449f-a137-92101309bd1e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:45.354545 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1181ef3a-7a82-449f-a137-92101309bd1e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:45.355332 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1181ef3a-7a82-449f-a137-92101309bd1e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:45.355752 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1181ef3a-7a82-449f-a137-92101309bd1e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:45.445449 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-35446672-84ac-4d11-a84f-0e38dfe5859d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 28203 microversion: 2.20 time: 0.139037 Nov 15 12:45:45.446095 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 450/870] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:45 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 28203 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:45:45.490571 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-1181ef3a-7a82-449f-a137-92101309bd1e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 28512 microversion: 2.1 time: 0.148081 Nov 15 12:45:45.494473 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 421/871] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:45 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 28512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:45:45.620625 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [req-90605b2d-a74b-40f0-96f5-04faf4da387d req-3cd4ceec-1701-48b1-b2ac-c8e4f1fce814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a56962f0-d8f9-4778-a21e-1f2bc81789fe", "name": "network-vif-plugged", "status": "completed", "tag": "5e3438d8-9d94-405a-af06-a2bd0727491d"}]} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:45.622250 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:45:45.622250 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: warnings.warn(msg) Nov 15 12:45:45.631586 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-90605b2d-a74b-40f0-96f5-04faf4da387d req-3cd4ceec-1701-48b1-b2ac-c8e4f1fce814 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:45.632056 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-90605b2d-a74b-40f0-96f5-04faf4da387d req-3cd4ceec-1701-48b1-b2ac-c8e4f1fce814 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:45.643837 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.compute.server_external_events [req-90605b2d-a74b-40f0-96f5-04faf4da387d req-3cd4ceec-1701-48b1-b2ac-c8e4f1fce814 service nova] Creating event network-vif-plugged:5e3438d8-9d94-405a-af06-a2bd0727491d for instance a56962f0-d8f9-4778-a21e-1f2bc81789fe on hv-cinder-68088 Nov 15 12:45:45.648695 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [req-90605b2d-a74b-40f0-96f5-04faf4da387d req-3cd4ceec-1701-48b1-b2ac-c8e4f1fce814 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033062 Nov 15 12:45:45.649623 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 451/872] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:45:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:45:46.457628 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-6b1cef7b-eff7-49cf-8c24-7eb038bffa0e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:46.458629 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-6b1cef7b-eff7-49cf-8c24-7eb038bffa0e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:46.467120 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6b1cef7b-eff7-49cf-8c24-7eb038bffa0e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:46.467640 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6b1cef7b-eff7-49cf-8c24-7eb038bffa0e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:46.468457 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6b1cef7b-eff7-49cf-8c24-7eb038bffa0e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:46.468883 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6b1cef7b-eff7-49cf-8c24-7eb038bffa0e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:46.502425 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e8bd4bb9-9475-4693-ae8f-fb3b976b332b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:46.503620 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e8bd4bb9-9475-4693-ae8f-fb3b976b332b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:46.509867 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e8bd4bb9-9475-4693-ae8f-fb3b976b332b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:46.510299 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e8bd4bb9-9475-4693-ae8f-fb3b976b332b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:46.511106 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e8bd4bb9-9475-4693-ae8f-fb3b976b332b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:46.511529 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e8bd4bb9-9475-4693-ae8f-fb3b976b332b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:46.585516 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-6b1cef7b-eff7-49cf-8c24-7eb038bffa0e tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 28494 microversion: 2.20 time: 0.132052 Nov 15 12:45:46.586194 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 422/873] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:46 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 28494 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 15 12:45:46.626999 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e8bd4bb9-9475-4693-ae8f-fb3b976b332b tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 28680 microversion: 2.1 time: 0.128328 Nov 15 12:45:46.627665 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 452/874] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:46 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 28680 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:45:47.598276 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-fb6bfda2-3dac-470a-b745-fbe9177a099d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:47.599232 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-fb6bfda2-3dac-470a-b745-fbe9177a099d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:47.606216 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fb6bfda2-3dac-470a-b745-fbe9177a099d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:47.606623 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fb6bfda2-3dac-470a-b745-fbe9177a099d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:47.607429 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fb6bfda2-3dac-470a-b745-fbe9177a099d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:47.607858 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fb6bfda2-3dac-470a-b745-fbe9177a099d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:47.645218 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-eebbad07-7b0a-49b1-80f6-c79baebeb79f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:47.646222 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-eebbad07-7b0a-49b1-80f6-c79baebeb79f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:47.653084 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-eebbad07-7b0a-49b1-80f6-c79baebeb79f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:47.653523 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-eebbad07-7b0a-49b1-80f6-c79baebeb79f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:47.654286 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-eebbad07-7b0a-49b1-80f6-c79baebeb79f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:47.654710 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-eebbad07-7b0a-49b1-80f6-c79baebeb79f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:47.730351 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-fb6bfda2-3dac-470a-b745-fbe9177a099d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 28661 microversion: 2.20 time: 0.136068 Nov 15 12:45:47.731604 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 423/875] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:47 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 28661 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:45:47.761043 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-eebbad07-7b0a-49b1-80f6-c79baebeb79f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 28680 microversion: 2.1 time: 0.119313 Nov 15 12:45:47.761694 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 453/876] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:47 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 28680 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:45:48.744327 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-8444bd06-a594-4b0f-975d-c9c09736278c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:48.745337 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-8444bd06-a594-4b0f-975d-c9c09736278c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:48.752397 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8444bd06-a594-4b0f-975d-c9c09736278c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:48.752830 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8444bd06-a594-4b0f-975d-c9c09736278c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:48.753595 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8444bd06-a594-4b0f-975d-c9c09736278c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:48.754013 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8444bd06-a594-4b0f-975d-c9c09736278c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:48.773868 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-a1134512-0dae-4fc6-8834-edc4769ab7f6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:48.774916 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-a1134512-0dae-4fc6-8834-edc4769ab7f6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:48.782723 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a1134512-0dae-4fc6-8834-edc4769ab7f6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:48.783199 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a1134512-0dae-4fc6-8834-edc4769ab7f6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:48.783990 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a1134512-0dae-4fc6-8834-edc4769ab7f6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:48.784425 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a1134512-0dae-4fc6-8834-edc4769ab7f6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:48.866131 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-8444bd06-a594-4b0f-975d-c9c09736278c tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 28661 microversion: 2.20 time: 0.125851 Nov 15 12:45:48.867098 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 424/877] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:48 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 28661 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:45:48.894431 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-a1134512-0dae-4fc6-8834-edc4769ab7f6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 28680 microversion: 2.1 time: 0.124504 Nov 15 12:45:48.895088 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 454/878] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:48 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 28680 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:45:49.878074 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-5fa05e16-807c-4e53-b8ec-6514e0a319d1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:49.879089 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-5fa05e16-807c-4e53-b8ec-6514e0a319d1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:49.885985 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5fa05e16-807c-4e53-b8ec-6514e0a319d1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:49.886428 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5fa05e16-807c-4e53-b8ec-6514e0a319d1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:49.887366 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5fa05e16-807c-4e53-b8ec-6514e0a319d1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:49.887803 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5fa05e16-807c-4e53-b8ec-6514e0a319d1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:49.906688 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-48dad56f-0096-46f6-acac-9ff918834216 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:49.907719 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-48dad56f-0096-46f6-acac-9ff918834216 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:49.915246 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-48dad56f-0096-46f6-acac-9ff918834216 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:49.916178 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-48dad56f-0096-46f6-acac-9ff918834216 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:49.916777 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-48dad56f-0096-46f6-acac-9ff918834216 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:49.917224 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-48dad56f-0096-46f6-acac-9ff918834216 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:49.998054 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-5fa05e16-807c-4e53-b8ec-6514e0a319d1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 28661 microversion: 2.20 time: 0.123913 Nov 15 12:45:49.998742 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 425/879] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:49 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 28661 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 15 12:45:50.047262 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-48dad56f-0096-46f6-acac-9ff918834216 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 29340 microversion: 2.1 time: 0.145185 Nov 15 12:45:50.048125 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 455/880] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:49 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 29340 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:45:51.010138 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-787709c3-576b-467d-9cee-7542c4841b39 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:51.011147 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-787709c3-576b-467d-9cee-7542c4841b39 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:51.018275 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-787709c3-576b-467d-9cee-7542c4841b39 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:51.018699 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-787709c3-576b-467d-9cee-7542c4841b39 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:51.019695 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-787709c3-576b-467d-9cee-7542c4841b39 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:51.019912 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-787709c3-576b-467d-9cee-7542c4841b39 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:51.059968 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-76119ee4-2b02-4ce9-9bab-1e4481d2386f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:51.060991 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-76119ee4-2b02-4ce9-9bab-1e4481d2386f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:51.067902 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-76119ee4-2b02-4ce9-9bab-1e4481d2386f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:51.068359 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-76119ee4-2b02-4ce9-9bab-1e4481d2386f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:51.069139 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-76119ee4-2b02-4ce9-9bab-1e4481d2386f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:51.069573 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-76119ee4-2b02-4ce9-9bab-1e4481d2386f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:51.118421 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-787709c3-576b-467d-9cee-7542c4841b39 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 28661 microversion: 2.20 time: 0.112176 Nov 15 12:45:51.119168 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 426/881] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:51 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 28661 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:45:51.186667 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-76119ee4-2b02-4ce9-9bab-1e4481d2386f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 31069 microversion: 2.1 time: 0.131084 Nov 15 12:45:51.187356 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 456/882] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:51 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 31069 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:45:52.130983 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-878a1826-84db-4136-b810-c622d4d85224 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:52.131996 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-878a1826-84db-4136-b810-c622d4d85224 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:52.140603 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-878a1826-84db-4136-b810-c622d4d85224 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:52.141059 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-878a1826-84db-4136-b810-c622d4d85224 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:52.145423 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-878a1826-84db-4136-b810-c622d4d85224 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:52.145952 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-878a1826-84db-4136-b810-c622d4d85224 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:52.197873 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-835f0175-594f-4a74-9b91-c8683b58d1e7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:52.198882 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-835f0175-594f-4a74-9b91-c8683b58d1e7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:52.206314 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-835f0175-594f-4a74-9b91-c8683b58d1e7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:52.206755 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-835f0175-594f-4a74-9b91-c8683b58d1e7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:52.207576 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-835f0175-594f-4a74-9b91-c8683b58d1e7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:52.207996 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-835f0175-594f-4a74-9b91-c8683b58d1e7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:52.257035 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-878a1826-84db-4136-b810-c622d4d85224 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 29410 microversion: 2.20 time: 0.130038 Nov 15 12:45:52.257695 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 427/883] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:52 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 29410 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:45:52.332144 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-835f0175-594f-4a74-9b91-c8683b58d1e7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 32328 microversion: 2.1 time: 0.138108 Nov 15 12:45:52.332797 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 457/884] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:52 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 32328 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:45:53.270263 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-c45fd98e-30dc-450e-b2ab-4483c59c1c95 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:53.271283 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-c45fd98e-30dc-450e-b2ab-4483c59c1c95 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:53.278794 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c45fd98e-30dc-450e-b2ab-4483c59c1c95 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:53.279299 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c45fd98e-30dc-450e-b2ab-4483c59c1c95 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:53.280072 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c45fd98e-30dc-450e-b2ab-4483c59c1c95 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:53.280507 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c45fd98e-30dc-450e-b2ab-4483c59c1c95 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:53.345218 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-807d07f6-aac0-4a23-81d1-1bb449d622c2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:53.346213 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-807d07f6-aac0-4a23-81d1-1bb449d622c2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:53.353251 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-807d07f6-aac0-4a23-81d1-1bb449d622c2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:53.353691 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-807d07f6-aac0-4a23-81d1-1bb449d622c2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:53.354453 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-807d07f6-aac0-4a23-81d1-1bb449d622c2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:53.354908 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-807d07f6-aac0-4a23-81d1-1bb449d622c2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:53.380884 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-c45fd98e-30dc-450e-b2ab-4483c59c1c95 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 31086 microversion: 2.20 time: 0.114810 Nov 15 12:45:53.383372 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 428/885] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:53 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 31086 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:45:53.460976 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-807d07f6-aac0-4a23-81d1-1bb449d622c2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 33185 microversion: 2.1 time: 0.120453 Nov 15 12:45:53.461588 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 458/886] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:53 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 33185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:45:54.392375 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-b0985d43-9bf8-440f-a0ac-7f705a6c6292 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:54.393367 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-b0985d43-9bf8-440f-a0ac-7f705a6c6292 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:54.400149 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b0985d43-9bf8-440f-a0ac-7f705a6c6292 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:54.400587 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b0985d43-9bf8-440f-a0ac-7f705a6c6292 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:54.401356 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b0985d43-9bf8-440f-a0ac-7f705a6c6292 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:54.401772 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b0985d43-9bf8-440f-a0ac-7f705a6c6292 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:54.473547 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-f2cc0e67-8fe0-4f06-a90f-260fb688e970 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:54.474449 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-f2cc0e67-8fe0-4f06-a90f-260fb688e970 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:54.482566 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f2cc0e67-8fe0-4f06-a90f-260fb688e970 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:54.483050 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f2cc0e67-8fe0-4f06-a90f-260fb688e970 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:54.483835 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f2cc0e67-8fe0-4f06-a90f-260fb688e970 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:54.484271 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f2cc0e67-8fe0-4f06-a90f-260fb688e970 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:54.517668 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-b0985d43-9bf8-440f-a0ac-7f705a6c6292 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 32206 microversion: 2.20 time: 0.129147 Nov 15 12:45:54.518320 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 429/887] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:54 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 32206 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 15 12:45:54.596657 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-f2cc0e67-8fe0-4f06-a90f-260fb688e970 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 33865 microversion: 2.1 time: 0.127091 Nov 15 12:45:54.597582 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 459/888] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:54 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 33865 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:45:55.531096 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-092731b7-d4db-415b-aeeb-ec3bfc09ece6 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:55.532087 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-092731b7-d4db-415b-aeeb-ec3bfc09ece6 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:55.539023 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-092731b7-d4db-415b-aeeb-ec3bfc09ece6 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:55.539470 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-092731b7-d4db-415b-aeeb-ec3bfc09ece6 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:55.540239 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-092731b7-d4db-415b-aeeb-ec3bfc09ece6 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:55.540668 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-092731b7-d4db-415b-aeeb-ec3bfc09ece6 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:55.608701 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-9924b82d-0c60-4ddf-bb69-961b7b1057f6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:55.609694 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-9924b82d-0c60-4ddf-bb69-961b7b1057f6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:55.616560 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9924b82d-0c60-4ddf-bb69-961b7b1057f6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:55.617010 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9924b82d-0c60-4ddf-bb69-961b7b1057f6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:55.617796 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9924b82d-0c60-4ddf-bb69-961b7b1057f6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:55.618234 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9924b82d-0c60-4ddf-bb69-961b7b1057f6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:55.661431 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-092731b7-d4db-415b-aeeb-ec3bfc09ece6 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 33048 microversion: 2.20 time: 0.135297 Nov 15 12:45:55.662346 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 430/889] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:55 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 33048 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:45:55.736150 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-9924b82d-0c60-4ddf-bb69-961b7b1057f6 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 35006 microversion: 2.1 time: 0.131367 Nov 15 12:45:55.736800 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 460/890] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:55 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 35006 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:45:56.674753 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-17a36c40-2c10-4001-af2d-8d5468b0f449 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:56.675776 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-17a36c40-2c10-4001-af2d-8d5468b0f449 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:56.682694 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-17a36c40-2c10-4001-af2d-8d5468b0f449 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:56.683157 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-17a36c40-2c10-4001-af2d-8d5468b0f449 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:56.684266 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-17a36c40-2c10-4001-af2d-8d5468b0f449 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:56.684437 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-17a36c40-2c10-4001-af2d-8d5468b0f449 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:56.748159 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-6f8db7b9-4149-44f3-b4ef-bb75c7c5221c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:56.749163 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-6f8db7b9-4149-44f3-b4ef-bb75c7c5221c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:56.756067 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6f8db7b9-4149-44f3-b4ef-bb75c7c5221c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:56.756522 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6f8db7b9-4149-44f3-b4ef-bb75c7c5221c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:56.757304 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6f8db7b9-4149-44f3-b4ef-bb75c7c5221c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:56.757740 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6f8db7b9-4149-44f3-b4ef-bb75c7c5221c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:56.787015 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-17a36c40-2c10-4001-af2d-8d5468b0f449 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 33659 microversion: 2.20 time: 0.116408 Nov 15 12:45:56.787662 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 431/891] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:56 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 33659 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:45:56.872255 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-6f8db7b9-4149-44f3-b4ef-bb75c7c5221c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 36896 microversion: 2.1 time: 0.127409 Nov 15 12:45:56.872912 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 461/892] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:56 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 36896 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:45:57.799880 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-7b24090b-2465-4830-9d3d-72d707809beb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:57.800866 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-7b24090b-2465-4830-9d3d-72d707809beb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:57.807801 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7b24090b-2465-4830-9d3d-72d707809beb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:57.808238 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7b24090b-2465-4830-9d3d-72d707809beb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:57.809667 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7b24090b-2465-4830-9d3d-72d707809beb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:57.810107 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7b24090b-2465-4830-9d3d-72d707809beb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:57.884928 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-5bf764c8-48e5-4c96-a542-fed6c13a08c2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:57.885934 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-5bf764c8-48e5-4c96-a542-fed6c13a08c2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:57.893413 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5bf764c8-48e5-4c96-a542-fed6c13a08c2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:57.893850 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5bf764c8-48e5-4c96-a542-fed6c13a08c2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:57.894622 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5bf764c8-48e5-4c96-a542-fed6c13a08c2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:57.895076 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5bf764c8-48e5-4c96-a542-fed6c13a08c2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:57.913511 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-7b24090b-2465-4830-9d3d-72d707809beb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 34618 microversion: 2.20 time: 0.117748 Nov 15 12:45:57.917742 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 432/893] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:57 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 34618 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:45:57.999819 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-5bf764c8-48e5-4c96-a542-fed6c13a08c2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 37986 microversion: 2.1 time: 0.118776 Nov 15 12:45:58.000502 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 462/894] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:57 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 37986 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:45:58.926232 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-a86008f6-cec6-40ae-a803-340457943f92 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:58.927281 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-a86008f6-cec6-40ae-a803-340457943f92 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:58.934571 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a86008f6-cec6-40ae-a803-340457943f92 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:58.935205 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a86008f6-cec6-40ae-a803-340457943f92 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:58.935993 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a86008f6-cec6-40ae-a803-340457943f92 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:58.936421 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a86008f6-cec6-40ae-a803-340457943f92 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:59.012770 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-151239ba-8b69-45fc-b8ef-52473073d9b7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:45:59.013843 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-151239ba-8b69-45fc-b8ef-52473073d9b7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:45:59.020676 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-151239ba-8b69-45fc-b8ef-52473073d9b7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:59.021122 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-151239ba-8b69-45fc-b8ef-52473073d9b7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:59.021891 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-151239ba-8b69-45fc-b8ef-52473073d9b7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:45:59.022320 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-151239ba-8b69-45fc-b8ef-52473073d9b7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:45:59.036809 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-a86008f6-cec6-40ae-a803-340457943f92 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 35632 microversion: 2.20 time: 0.114495 Nov 15 12:45:59.040928 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 433/895] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:45:58 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 35632 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:45:59.117038 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-151239ba-8b69-45fc-b8ef-52473073d9b7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 38200 microversion: 2.1 time: 0.108667 Nov 15 12:45:59.117713 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 463/896] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:45:59 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 38200 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:46:00.049991 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-09a6e3b9-25b8-405a-8465-de2cf7181ceb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:46:00.051006 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-09a6e3b9-25b8-405a-8465-de2cf7181ceb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:00.057776 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-09a6e3b9-25b8-405a-8465-de2cf7181ceb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:00.058212 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-09a6e3b9-25b8-405a-8465-de2cf7181ceb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:00.059543 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-09a6e3b9-25b8-405a-8465-de2cf7181ceb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:00.060158 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-09a6e3b9-25b8-405a-8465-de2cf7181ceb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:00.129488 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-a4e8ed2c-9e97-4e38-890a-5e4d9c796a59 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:46:00.130505 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-a4e8ed2c-9e97-4e38-890a-5e4d9c796a59 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:00.137725 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a4e8ed2c-9e97-4e38-890a-5e4d9c796a59 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:00.138173 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a4e8ed2c-9e97-4e38-890a-5e4d9c796a59 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:00.138991 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a4e8ed2c-9e97-4e38-890a-5e4d9c796a59 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:00.139426 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a4e8ed2c-9e97-4e38-890a-5e4d9c796a59 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:00.175407 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-09a6e3b9-25b8-405a-8465-de2cf7181ceb tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 36925 microversion: 2.20 time: 0.129527 Nov 15 12:46:00.176406 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 434/897] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:46:00 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 36925 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:46:00.237113 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-a4e8ed2c-9e97-4e38-890a-5e4d9c796a59 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 38200 microversion: 2.1 time: 0.111563 Nov 15 12:46:00.237782 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 464/898] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:46:00 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 38200 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:46:01.188349 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-d3834ff1-98e3-46ab-b852-68539383dae0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:46:01.189328 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-d3834ff1-98e3-46ab-b852-68539383dae0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:01.196318 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d3834ff1-98e3-46ab-b852-68539383dae0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:01.196758 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d3834ff1-98e3-46ab-b852-68539383dae0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:01.197519 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d3834ff1-98e3-46ab-b852-68539383dae0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:01.197941 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d3834ff1-98e3-46ab-b852-68539383dae0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:01.249708 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-1d72bc42-c04e-422b-836e-f913e0f076ef tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:46:01.250701 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-1d72bc42-c04e-422b-836e-f913e0f076ef tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:01.257885 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1d72bc42-c04e-422b-836e-f913e0f076ef tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:01.258336 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1d72bc42-c04e-422b-836e-f913e0f076ef tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:01.259158 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1d72bc42-c04e-422b-836e-f913e0f076ef tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:01.259590 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1d72bc42-c04e-422b-836e-f913e0f076ef tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:01.304173 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-d3834ff1-98e3-46ab-b852-68539383dae0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 38209 microversion: 2.20 time: 0.120161 Nov 15 12:46:01.305204 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 435/899] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:46:01 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 38209 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:46:01.366251 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-1d72bc42-c04e-422b-836e-f913e0f076ef tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 38200 microversion: 2.1 time: 0.121088 Nov 15 12:46:01.367032 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 465/900] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:46:01 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 38200 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:46:02.316728 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-50f50b5a-971b-4b42-b3a0-b2a83b2749d9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:46:02.317747 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-50f50b5a-971b-4b42-b3a0-b2a83b2749d9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:02.325001 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-50f50b5a-971b-4b42-b3a0-b2a83b2749d9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:02.325444 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-50f50b5a-971b-4b42-b3a0-b2a83b2749d9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:02.326219 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-50f50b5a-971b-4b42-b3a0-b2a83b2749d9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:02.326643 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-50f50b5a-971b-4b42-b3a0-b2a83b2749d9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:02.379082 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-f53713c3-aba1-44d7-bbc9-0bf9a38d18a9 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:46:02.380096 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-f53713c3-aba1-44d7-bbc9-0bf9a38d18a9 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:02.386920 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f53713c3-aba1-44d7-bbc9-0bf9a38d18a9 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:02.387369 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f53713c3-aba1-44d7-bbc9-0bf9a38d18a9 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:02.388149 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f53713c3-aba1-44d7-bbc9-0bf9a38d18a9 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:02.388577 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f53713c3-aba1-44d7-bbc9-0bf9a38d18a9 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:02.412016 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-50f50b5a-971b-4b42-b3a0-b2a83b2749d9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 38209 microversion: 2.20 time: 0.099170 Nov 15 12:46:02.412681 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 436/901] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:46:02 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 38209 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:46:02.498959 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-f53713c3-aba1-44d7-bbc9-0bf9a38d18a9 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action" status: 200 len: 38329 microversion: 2.1 time: 0.123648 Nov 15 12:46:02.500032 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 466/902] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:46:02 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/action => generated 38329 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 15 12:46:02.510067 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-76d4a0b3-2295-41f1-acad-f7caab1df343 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:02.510638 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-76d4a0b3-2295-41f1-acad-f7caab1df343 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:02.518002 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-76d4a0b3-2295-41f1-acad-f7caab1df343 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:02.518447 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-76d4a0b3-2295-41f1-acad-f7caab1df343 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:02.519349 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-76d4a0b3-2295-41f1-acad-f7caab1df343 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:02.519785 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-76d4a0b3-2295-41f1-acad-f7caab1df343 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:02.547322 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-76d4a0b3-2295-41f1-acad-f7caab1df343 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/ips" status: 200 len: 144 microversion: 2.1 time: 0.041252 Nov 15 12:46:02.547903 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 437/903] 10.222.0.43 () {58 vars in 1247 bytes} [Mon Nov 15 12:46:02 2021] GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/ips => generated 144 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 15 12:46:03.425286 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-3e0f12d5-8693-4514-9e6c-6855d1fd83db tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:46:03.426289 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-3e0f12d5-8693-4514-9e6c-6855d1fd83db tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:03.433168 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3e0f12d5-8693-4514-9e6c-6855d1fd83db tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:03.434127 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3e0f12d5-8693-4514-9e6c-6855d1fd83db tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:03.434935 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3e0f12d5-8693-4514-9e6c-6855d1fd83db tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:03.435373 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3e0f12d5-8693-4514-9e6c-6855d1fd83db tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:03.532376 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-3e0f12d5-8693-4514-9e6c-6855d1fd83db tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 38209 microversion: 2.20 time: 0.110970 Nov 15 12:46:03.533199 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 467/904] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:46:03 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 38209 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:46:03.853766 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-ca9bf627-5098-4255-a125-b2cc41ba40da tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e516c575-1615-4726-b22b-2fa403f27d7e"}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:46:03.854856 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-ca9bf627-5098-4255-a125-b2cc41ba40da tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:03.861273 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ca9bf627-5098-4255-a125-b2cc41ba40da tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:03.861745 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ca9bf627-5098-4255-a125-b2cc41ba40da tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:03.862513 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ca9bf627-5098-4255-a125-b2cc41ba40da tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:03.862985 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ca9bf627-5098-4255-a125-b2cc41ba40da tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:04.130146 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-ca9bf627-5098-4255-a125-b2cc41ba40da tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280027 Nov 15 12:46:04.130959 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 438/905] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Nov 15 12:46:03 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:46:04.546267 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-bc140f4d-3a2b-4953-af0e-fe39e3ebb8d2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:46:04.547203 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-bc140f4d-3a2b-4953-af0e-fe39e3ebb8d2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:04.554796 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bc140f4d-3a2b-4953-af0e-fe39e3ebb8d2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:04.555186 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bc140f4d-3a2b-4953-af0e-fe39e3ebb8d2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:04.555954 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bc140f4d-3a2b-4953-af0e-fe39e3ebb8d2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:04.556378 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bc140f4d-3a2b-4953-af0e-fe39e3ebb8d2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:04.662248 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-bc140f4d-3a2b-4953-af0e-fe39e3ebb8d2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 200 len: 38351 microversion: 2.20 time: 0.120918 Nov 15 12:46:04.662990 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 468/906] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:46:04 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 38351 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:46:04.674743 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-83e14e17-dd39-4409-98b9-aedf9a94c564 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:04.675345 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-83e14e17-dd39-4409-98b9-aedf9a94c564 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:04.681480 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-83e14e17-dd39-4409-98b9-aedf9a94c564 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:04.681925 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-83e14e17-dd39-4409-98b9-aedf9a94c564 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:04.682693 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-83e14e17-dd39-4409-98b9-aedf9a94c564 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:04.683155 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-83e14e17-dd39-4409-98b9-aedf9a94c564 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:04.708057 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-83e14e17-dd39-4409-98b9-aedf9a94c564 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/ips" status: 200 len: 151 microversion: 2.20 time: 0.038253 Nov 15 12:46:04.708629 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 439/907] 10.222.0.43 () {60 vars in 1288 bytes} [Mon Nov 15 12:46:04 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:46:06.807783 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-f28a9e36-6bc6-4c90-bd70-e24d249b0851 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:46:06.808419 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-f28a9e36-6bc6-4c90-bd70-e24d249b0851 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:06.816142 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f28a9e36-6bc6-4c90-bd70-e24d249b0851 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:06.816585 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f28a9e36-6bc6-4c90-bd70-e24d249b0851 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:06.817359 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f28a9e36-6bc6-4c90-bd70-e24d249b0851 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:06.817791 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f28a9e36-6bc6-4c90-bd70-e24d249b0851 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:06.840265 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.objects.instance [None req-f28a9e36-6bc6-4c90-bd70-e24d249b0851 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lazy-loading 'flavor' on Instance uuid 12e0ab18-a841-4228-bebb-1c5d1db6f7f6 {{(pid=122567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 15 12:46:07.104178 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-f28a9e36-6bc6-4c90-bd70-e24d249b0851 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 202 len: 0 microversion: 2.20 time: 0.300364 Nov 15 12:46:07.104820 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 469/908] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:46:06 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 15 12:46:07.114450 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-e1c435f8-fca4-4c08-be1e-4d9609357b06 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:07.115151 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-e1c435f8-fca4-4c08-be1e-4d9609357b06 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:07.122454 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e1c435f8-fca4-4c08-be1e-4d9609357b06 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:07.122943 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e1c435f8-fca4-4c08-be1e-4d9609357b06 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:07.124401 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e1c435f8-fca4-4c08-be1e-4d9609357b06 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:07.124855 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e1c435f8-fca4-4c08-be1e-4d9609357b06 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:07.258370 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-e1c435f8-fca4-4c08-be1e-4d9609357b06 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:07.267408 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-e1c435f8-fca4-4c08-be1e-4d9609357b06 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:07.268898 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-e1c435f8-fca4-4c08-be1e-4d9609357b06 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:07.270049 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-e1c435f8-fca4-4c08-be1e-4d9609357b06 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1722 microversion: 2.20 time: 0.159520 Nov 15 12:46:07.270612 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 440/909] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:07 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:08.290282 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-5382a74e-dfcc-46e8-b6d7-d6f4ac634299 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:08.291042 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-5382a74e-dfcc-46e8-b6d7-d6f4ac634299 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:08.298273 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5382a74e-dfcc-46e8-b6d7-d6f4ac634299 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:08.298726 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5382a74e-dfcc-46e8-b6d7-d6f4ac634299 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:08.299543 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5382a74e-dfcc-46e8-b6d7-d6f4ac634299 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:08.299980 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5382a74e-dfcc-46e8-b6d7-d6f4ac634299 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:08.443348 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-5382a74e-dfcc-46e8-b6d7-d6f4ac634299 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:08.451636 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-5382a74e-dfcc-46e8-b6d7-d6f4ac634299 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:08.453130 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-5382a74e-dfcc-46e8-b6d7-d6f4ac634299 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:08.454286 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-5382a74e-dfcc-46e8-b6d7-d6f4ac634299 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1722 microversion: 2.20 time: 0.168636 Nov 15 12:46:08.454870 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 470/910] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:08 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:09.690588 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-2f36ebf1-6c8a-40d0-a991-daa1286ace20 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:09.691218 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-2f36ebf1-6c8a-40d0-a991-daa1286ace20 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:09.697000 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2f36ebf1-6c8a-40d0-a991-daa1286ace20 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:09.697434 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2f36ebf1-6c8a-40d0-a991-daa1286ace20 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:09.698302 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2f36ebf1-6c8a-40d0-a991-daa1286ace20 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:09.698727 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2f36ebf1-6c8a-40d0-a991-daa1286ace20 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:09.831846 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-2f36ebf1-6c8a-40d0-a991-daa1286ace20 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:09.840286 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-2f36ebf1-6c8a-40d0-a991-daa1286ace20 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:09.842076 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-2f36ebf1-6c8a-40d0-a991-daa1286ace20 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:09.843260 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-2f36ebf1-6c8a-40d0-a991-daa1286ace20 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1722 microversion: 2.20 time: 0.373856 Nov 15 12:46:09.843828 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 441/911] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:09 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1722 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:10.861942 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-8a76cc5a-3db0-40c8-9770-e9bfbf459f68 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:10.863065 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-8a76cc5a-3db0-40c8-9770-e9bfbf459f68 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:10.869249 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8a76cc5a-3db0-40c8-9770-e9bfbf459f68 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:10.869689 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8a76cc5a-3db0-40c8-9770-e9bfbf459f68 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:10.870456 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8a76cc5a-3db0-40c8-9770-e9bfbf459f68 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:10.871415 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8a76cc5a-3db0-40c8-9770-e9bfbf459f68 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:11.006726 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-8a76cc5a-3db0-40c8-9770-e9bfbf459f68 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:11.015450 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-8a76cc5a-3db0-40c8-9770-e9bfbf459f68 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:11.016958 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-8a76cc5a-3db0-40c8-9770-e9bfbf459f68 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:11.018653 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-8a76cc5a-3db0-40c8-9770-e9bfbf459f68 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1722 microversion: 2.20 time: 0.160573 Nov 15 12:46:11.019573 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 471/912] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:10 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:11.609657 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-5e8d5fc3-0aea-4e3d-92d0-af4ed64981ce tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:11.610625 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-5e8d5fc3-0aea-4e3d-92d0-af4ed64981ce tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:11.616988 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5e8d5fc3-0aea-4e3d-92d0-af4ed64981ce tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:11.617426 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5e8d5fc3-0aea-4e3d-92d0-af4ed64981ce tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:11.618192 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5e8d5fc3-0aea-4e3d-92d0-af4ed64981ce tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:11.618617 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5e8d5fc3-0aea-4e3d-92d0-af4ed64981ce tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:11.648539 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-5e8d5fc3-0aea-4e3d-92d0-af4ed64981ce tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043087 Nov 15 12:46:11.649006 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 442/913] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Nov 15 12:46:11 2021] GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:46:11.659792 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-347c8d2c-3040-49c0-914b-8729f32112ef tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:11.660276 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-347c8d2c-3040-49c0-914b-8729f32112ef tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:11.666550 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-347c8d2c-3040-49c0-914b-8729f32112ef tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:11.667030 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-347c8d2c-3040-49c0-914b-8729f32112ef tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:11.668422 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-347c8d2c-3040-49c0-914b-8729f32112ef tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:11.668859 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-347c8d2c-3040-49c0-914b-8729f32112ef tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:11.697054 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-347c8d2c-3040-49c0-914b-8729f32112ef tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/os-volume_attachments/e516c575-1615-4726-b22b-2fa403f27d7e" status: 200 len: 194 microversion: 2.1 time: 0.041264 Nov 15 12:46:11.697633 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 472/914] 10.222.0.43 () {58 vars in 1412 bytes} [Mon Nov 15 12:46:11 2021] GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/os-volume_attachments/e516c575-1615-4726-b22b-2fa403f27d7e => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:46:12.046540 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-6705659c-afcb-41e8-a46f-cee460382ffa tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:12.047186 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-6705659c-afcb-41e8-a46f-cee460382ffa tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:12.053049 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6705659c-afcb-41e8-a46f-cee460382ffa tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:12.053495 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6705659c-afcb-41e8-a46f-cee460382ffa tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:12.054262 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6705659c-afcb-41e8-a46f-cee460382ffa tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:12.054687 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6705659c-afcb-41e8-a46f-cee460382ffa tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:12.190602 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-6705659c-afcb-41e8-a46f-cee460382ffa tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:12.202809 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-6705659c-afcb-41e8-a46f-cee460382ffa tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:12.204300 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-6705659c-afcb-41e8-a46f-cee460382ffa tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:12.205460 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-6705659c-afcb-41e8-a46f-cee460382ffa tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1722 microversion: 2.20 time: 0.163958 Nov 15 12:46:12.206025 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 443/915] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:12 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:13.004092 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-327a2ad3-c4a7-44f2-97cf-f6e932701a24 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53db0e39-2c1c-4ab9-8a7e-02f5aad870de"}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:46:13.005186 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-327a2ad3-c4a7-44f2-97cf-f6e932701a24 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:13.011609 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-327a2ad3-c4a7-44f2-97cf-f6e932701a24 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:13.011886 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-327a2ad3-c4a7-44f2-97cf-f6e932701a24 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:13.012648 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-327a2ad3-c4a7-44f2-97cf-f6e932701a24 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:13.013071 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-327a2ad3-c4a7-44f2-97cf-f6e932701a24 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:13.224398 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-1ac2f7eb-9c75-477d-9f35-9853d8a9cbf0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:13.224991 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-1ac2f7eb-9c75-477d-9f35-9853d8a9cbf0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:13.232575 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1ac2f7eb-9c75-477d-9f35-9853d8a9cbf0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:13.233212 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1ac2f7eb-9c75-477d-9f35-9853d8a9cbf0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:13.234333 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1ac2f7eb-9c75-477d-9f35-9853d8a9cbf0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:13.235071 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1ac2f7eb-9c75-477d-9f35-9853d8a9cbf0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:13.285155 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-327a2ad3-c4a7-44f2-97cf-f6e932701a24 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284614 Nov 15 12:46:13.290392 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 473/916] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Nov 15 12:46:12 2021] POST /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:46:13.383797 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-1ac2f7eb-9c75-477d-9f35-9853d8a9cbf0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:13.392342 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-1ac2f7eb-9c75-477d-9f35-9853d8a9cbf0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:13.393838 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-1ac2f7eb-9c75-477d-9f35-9853d8a9cbf0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:13.395027 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-1ac2f7eb-9c75-477d-9f35-9853d8a9cbf0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1722 microversion: 2.20 time: 0.174393 Nov 15 12:46:13.395574 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 444/917] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:13 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 15 12:46:14.414105 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-64569c7a-6893-43c7-b9de-603eb051ab41 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:14.414831 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-64569c7a-6893-43c7-b9de-603eb051ab41 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:14.421660 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-64569c7a-6893-43c7-b9de-603eb051ab41 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:14.422095 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-64569c7a-6893-43c7-b9de-603eb051ab41 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:14.422892 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-64569c7a-6893-43c7-b9de-603eb051ab41 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:14.423319 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-64569c7a-6893-43c7-b9de-603eb051ab41 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:14.555849 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-64569c7a-6893-43c7-b9de-603eb051ab41 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:14.564014 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-64569c7a-6893-43c7-b9de-603eb051ab41 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:14.565511 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-64569c7a-6893-43c7-b9de-603eb051ab41 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:14.566672 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-64569c7a-6893-43c7-b9de-603eb051ab41 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1722 microversion: 2.20 time: 0.157041 Nov 15 12:46:14.567288 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 474/918] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:14 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:15.585432 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-44dbed5f-9b8d-4915-83d3-13544f6c000b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:15.586072 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-44dbed5f-9b8d-4915-83d3-13544f6c000b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:15.593368 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-44dbed5f-9b8d-4915-83d3-13544f6c000b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:15.593812 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-44dbed5f-9b8d-4915-83d3-13544f6c000b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:15.594580 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-44dbed5f-9b8d-4915-83d3-13544f6c000b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:15.595040 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-44dbed5f-9b8d-4915-83d3-13544f6c000b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:15.723990 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-44dbed5f-9b8d-4915-83d3-13544f6c000b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:15.732292 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-44dbed5f-9b8d-4915-83d3-13544f6c000b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:15.733762 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-44dbed5f-9b8d-4915-83d3-13544f6c000b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:15.734934 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-44dbed5f-9b8d-4915-83d3-13544f6c000b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1722 microversion: 2.20 time: 0.153365 Nov 15 12:46:15.735490 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 445/919] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:15 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:16.753496 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-8476f1f0-52cc-4213-a76d-8e5367fb585a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:16.754055 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-8476f1f0-52cc-4213-a76d-8e5367fb585a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:16.760566 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8476f1f0-52cc-4213-a76d-8e5367fb585a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:16.761013 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8476f1f0-52cc-4213-a76d-8e5367fb585a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:16.762627 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8476f1f0-52cc-4213-a76d-8e5367fb585a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:16.763200 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8476f1f0-52cc-4213-a76d-8e5367fb585a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:16.899513 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-8476f1f0-52cc-4213-a76d-8e5367fb585a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:16.908223 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-8476f1f0-52cc-4213-a76d-8e5367fb585a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:16.909738 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-8476f1f0-52cc-4213-a76d-8e5367fb585a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:16.910918 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-8476f1f0-52cc-4213-a76d-8e5367fb585a tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1722 microversion: 2.20 time: 0.161198 Nov 15 12:46:16.911480 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 475/920] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:16 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:17.930007 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-4a22a2f8-9528-454f-b88b-39c7e5569369 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:17.930611 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-4a22a2f8-9528-454f-b88b-39c7e5569369 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:17.937751 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4a22a2f8-9528-454f-b88b-39c7e5569369 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:17.938199 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4a22a2f8-9528-454f-b88b-39c7e5569369 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:17.939007 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4a22a2f8-9528-454f-b88b-39c7e5569369 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:17.939441 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4a22a2f8-9528-454f-b88b-39c7e5569369 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:18.076299 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-4a22a2f8-9528-454f-b88b-39c7e5569369 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:18.084192 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-4a22a2f8-9528-454f-b88b-39c7e5569369 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:18.085688 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-4a22a2f8-9528-454f-b88b-39c7e5569369 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:18.086871 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-4a22a2f8-9528-454f-b88b-39c7e5569369 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1722 microversion: 2.20 time: 0.161105 Nov 15 12:46:18.087435 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 446/921] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:17 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:19.106624 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-dac5d80a-0a5d-49b2-a5d0-316026616567 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:19.107958 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-dac5d80a-0a5d-49b2-a5d0-316026616567 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:19.118341 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-dac5d80a-0a5d-49b2-a5d0-316026616567 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:19.118799 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-dac5d80a-0a5d-49b2-a5d0-316026616567 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:19.119584 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-dac5d80a-0a5d-49b2-a5d0-316026616567 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:19.120011 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-dac5d80a-0a5d-49b2-a5d0-316026616567 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:19.267383 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-dac5d80a-0a5d-49b2-a5d0-316026616567 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:19.275034 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-dac5d80a-0a5d-49b2-a5d0-316026616567 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:19.276517 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-dac5d80a-0a5d-49b2-a5d0-316026616567 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:19.278023 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-dac5d80a-0a5d-49b2-a5d0-316026616567 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1722 microversion: 2.20 time: 0.176044 Nov 15 12:46:19.278594 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 476/922] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:19 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:20.296528 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-b619999c-6d64-4f1c-8612-84b33f602628 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:20.297113 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-b619999c-6d64-4f1c-8612-84b33f602628 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:20.303438 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b619999c-6d64-4f1c-8612-84b33f602628 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:20.303884 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b619999c-6d64-4f1c-8612-84b33f602628 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:20.304658 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b619999c-6d64-4f1c-8612-84b33f602628 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:20.305086 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b619999c-6d64-4f1c-8612-84b33f602628 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:20.437473 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-b619999c-6d64-4f1c-8612-84b33f602628 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:20.445155 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-b619999c-6d64-4f1c-8612-84b33f602628 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:20.446623 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-b619999c-6d64-4f1c-8612-84b33f602628 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:20.447786 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-b619999c-6d64-4f1c-8612-84b33f602628 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1722 microversion: 2.20 time: 0.156128 Nov 15 12:46:20.448328 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 447/923] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:20 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:20.753987 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-335c33a6-25b2-4345-ac1d-f98b41ca467e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:20.754973 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-335c33a6-25b2-4345-ac1d-f98b41ca467e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:20.761897 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-335c33a6-25b2-4345-ac1d-f98b41ca467e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:20.762610 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-335c33a6-25b2-4345-ac1d-f98b41ca467e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:20.763430 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-335c33a6-25b2-4345-ac1d-f98b41ca467e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:20.763867 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-335c33a6-25b2-4345-ac1d-f98b41ca467e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:20.793876 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-335c33a6-25b2-4345-ac1d-f98b41ca467e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043728 Nov 15 12:46:20.794440 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 477/924] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Nov 15 12:46:20 2021] GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:46:20.996696 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-351d3aaf-0e8d-4af3-8f0a-b9e7a6be763d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:20.997173 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-351d3aaf-0e8d-4af3-8f0a-b9e7a6be763d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:21.003101 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-351d3aaf-0e8d-4af3-8f0a-b9e7a6be763d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:21.003551 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-351d3aaf-0e8d-4af3-8f0a-b9e7a6be763d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:21.004420 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-351d3aaf-0e8d-4af3-8f0a-b9e7a6be763d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:21.005055 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-351d3aaf-0e8d-4af3-8f0a-b9e7a6be763d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:21.034521 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-351d3aaf-0e8d-4af3-8f0a-b9e7a6be763d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/os-volume_attachments/e516c575-1615-4726-b22b-2fa403f27d7e" status: 200 len: 194 microversion: 2.1 time: 0.042310 Nov 15 12:46:21.035125 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 448/925] 10.222.0.43 () {58 vars in 1412 bytes} [Mon Nov 15 12:46:20 2021] GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/os-volume_attachments/e516c575-1615-4726-b22b-2fa403f27d7e => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:46:21.044527 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-9710a0fe-f557-4d13-9e9d-0b7cc99563b2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:21.045299 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-9710a0fe-f557-4d13-9e9d-0b7cc99563b2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:21.051082 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9710a0fe-f557-4d13-9e9d-0b7cc99563b2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:21.051527 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9710a0fe-f557-4d13-9e9d-0b7cc99563b2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:21.052300 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9710a0fe-f557-4d13-9e9d-0b7cc99563b2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:21.052725 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9710a0fe-f557-4d13-9e9d-0b7cc99563b2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:21.140631 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.objects.instance [None req-9710a0fe-f557-4d13-9e9d-0b7cc99563b2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lazy-loading 'services' on Instance uuid 0ceda11b-c435-4946-bbc9-f6ce1134e847 {{(pid=122567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 15 12:46:21.214085 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-9710a0fe-f557-4d13-9e9d-0b7cc99563b2 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/os-volume_attachments/e516c575-1615-4726-b22b-2fa403f27d7e" status: 202 len: 0 microversion: 2.1 time: 0.173317 Nov 15 12:46:21.214852 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 478/926] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Nov 15 12:46:21 2021] DELETE /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/os-volume_attachments/e516c575-1615-4726-b22b-2fa403f27d7e => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:46:21.466886 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-99e53ca4-7cc8-4531-a55d-a46cc43d5028 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:21.467471 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-99e53ca4-7cc8-4531-a55d-a46cc43d5028 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:21.473773 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-99e53ca4-7cc8-4531-a55d-a46cc43d5028 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:21.474211 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-99e53ca4-7cc8-4531-a55d-a46cc43d5028 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:21.475000 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-99e53ca4-7cc8-4531-a55d-a46cc43d5028 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:21.475432 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-99e53ca4-7cc8-4531-a55d-a46cc43d5028 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:21.604187 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-99e53ca4-7cc8-4531-a55d-a46cc43d5028 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:21.612552 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-99e53ca4-7cc8-4531-a55d-a46cc43d5028 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:21.614021 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-99e53ca4-7cc8-4531-a55d-a46cc43d5028 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:21.615192 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-99e53ca4-7cc8-4531-a55d-a46cc43d5028 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1722 microversion: 2.20 time: 0.152488 Nov 15 12:46:21.615745 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 449/927] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:21 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:22.634270 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-6d6a6cc2-3d20-4527-9100-d12b7b90f339 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:22.634911 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-6d6a6cc2-3d20-4527-9100-d12b7b90f339 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:22.642044 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6d6a6cc2-3d20-4527-9100-d12b7b90f339 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:22.642498 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6d6a6cc2-3d20-4527-9100-d12b7b90f339 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:22.643321 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6d6a6cc2-3d20-4527-9100-d12b7b90f339 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:22.643751 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6d6a6cc2-3d20-4527-9100-d12b7b90f339 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:22.776554 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-6d6a6cc2-3d20-4527-9100-d12b7b90f339 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:22.784389 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-6d6a6cc2-3d20-4527-9100-d12b7b90f339 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:22.785876 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-6d6a6cc2-3d20-4527-9100-d12b7b90f339 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:22.787077 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-6d6a6cc2-3d20-4527-9100-d12b7b90f339 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1743 microversion: 2.20 time: 0.157401 Nov 15 12:46:22.787635 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 479/928] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:22 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 15 12:46:23.379527 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-c828179f-2df8-438a-a69e-5001ceadb1f7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:23.380099 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-c828179f-2df8-438a-a69e-5001ceadb1f7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:23.386455 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c828179f-2df8-438a-a69e-5001ceadb1f7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:23.386952 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c828179f-2df8-438a-a69e-5001ceadb1f7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:23.387719 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c828179f-2df8-438a-a69e-5001ceadb1f7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:23.388144 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c828179f-2df8-438a-a69e-5001ceadb1f7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:23.418750 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-c828179f-2df8-438a-a69e-5001ceadb1f7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/os-volume_attachments/53db0e39-2c1c-4ab9-8a7e-02f5aad870de" status: 200 len: 194 microversion: 2.1 time: 0.042830 Nov 15 12:46:23.419409 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 450/929] 10.222.0.43 () {58 vars in 1412 bytes} [Mon Nov 15 12:46:23 2021] GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/os-volume_attachments/53db0e39-2c1c-4ab9-8a7e-02f5aad870de => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:46:23.429184 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-b08e9386-3978-4282-b09f-a98489afa470 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:23.429604 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-b08e9386-3978-4282-b09f-a98489afa470 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:23.435423 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b08e9386-3978-4282-b09f-a98489afa470 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:23.435867 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b08e9386-3978-4282-b09f-a98489afa470 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:23.436631 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b08e9386-3978-4282-b09f-a98489afa470 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:23.437060 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b08e9386-3978-4282-b09f-a98489afa470 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:23.516585 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.objects.instance [None req-b08e9386-3978-4282-b09f-a98489afa470 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lazy-loading 'services' on Instance uuid 0ceda11b-c435-4946-bbc9-f6ce1134e847 {{(pid=122567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 15 12:46:23.585217 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-b08e9386-3978-4282-b09f-a98489afa470 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/os-volume_attachments/53db0e39-2c1c-4ab9-8a7e-02f5aad870de" status: 202 len: 0 microversion: 2.1 time: 0.159530 Nov 15 12:46:23.585811 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 480/930] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Nov 15 12:46:23 2021] DELETE /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/os-volume_attachments/53db0e39-2c1c-4ab9-8a7e-02f5aad870de => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:46:23.806572 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-d8ad758e-3a6e-4c7c-b2ff-f3f000e1ee80 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:23.807161 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-d8ad758e-3a6e-4c7c-b2ff-f3f000e1ee80 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:23.813212 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d8ad758e-3a6e-4c7c-b2ff-f3f000e1ee80 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:23.813654 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d8ad758e-3a6e-4c7c-b2ff-f3f000e1ee80 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:23.814432 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d8ad758e-3a6e-4c7c-b2ff-f3f000e1ee80 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:23.814888 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d8ad758e-3a6e-4c7c-b2ff-f3f000e1ee80 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:23.950488 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-d8ad758e-3a6e-4c7c-b2ff-f3f000e1ee80 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:23.958295 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-d8ad758e-3a6e-4c7c-b2ff-f3f000e1ee80 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:23.959805 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-d8ad758e-3a6e-4c7c-b2ff-f3f000e1ee80 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:23.960942 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-d8ad758e-3a6e-4c7c-b2ff-f3f000e1ee80 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1743 microversion: 2.20 time: 0.158218 Nov 15 12:46:23.961490 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 451/931] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:23 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:24.740005 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-56f1f379-0b1b-40be-9dd6-27fdefe9261f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:24.741074 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-56f1f379-0b1b-40be-9dd6-27fdefe9261f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:24.747889 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-56f1f379-0b1b-40be-9dd6-27fdefe9261f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:24.748340 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-56f1f379-0b1b-40be-9dd6-27fdefe9261f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:24.749155 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-56f1f379-0b1b-40be-9dd6-27fdefe9261f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:24.749592 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-56f1f379-0b1b-40be-9dd6-27fdefe9261f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:24.779229 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-56f1f379-0b1b-40be-9dd6-27fdefe9261f tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043234 Nov 15 12:46:24.779808 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 481/932] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Nov 15 12:46:24 2021] GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 15 12:46:24.882953 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-45bda94a-6689-4183-a751-76137b731251 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:24.884430 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-45bda94a-6689-4183-a751-76137b731251 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:24.893424 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-45bda94a-6689-4183-a751-76137b731251 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:24.893858 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-45bda94a-6689-4183-a751-76137b731251 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:24.894635 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-45bda94a-6689-4183-a751-76137b731251 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:24.895081 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-45bda94a-6689-4183-a751-76137b731251 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:24.935136 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-45bda94a-6689-4183-a751-76137b731251 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055821 Nov 15 12:46:24.935702 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 452/933] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Nov 15 12:46:24 2021] GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 15 12:46:24.979676 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e0055dbd-6777-4f33-b9fa-f7a9990b9032 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:24.980826 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e0055dbd-6777-4f33-b9fa-f7a9990b9032 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:24.987237 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e0055dbd-6777-4f33-b9fa-f7a9990b9032 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:24.987683 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e0055dbd-6777-4f33-b9fa-f7a9990b9032 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:24.988526 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e0055dbd-6777-4f33-b9fa-f7a9990b9032 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:24.988894 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e0055dbd-6777-4f33-b9fa-f7a9990b9032 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:24.996375 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-52c68274-7f18-4dc6-b471-6860da58467a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:24.996894 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-52c68274-7f18-4dc6-b471-6860da58467a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:25.004554 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-52c68274-7f18-4dc6-b471-6860da58467a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:25.005001 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-52c68274-7f18-4dc6-b471-6860da58467a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:25.005785 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-52c68274-7f18-4dc6-b471-6860da58467a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:25.006213 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-52c68274-7f18-4dc6-b471-6860da58467a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:25.036471 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-52c68274-7f18-4dc6-b471-6860da58467a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Going to try to terminate instance {{(pid=122568) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 15 12:46:25.124122 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-52c68274-7f18-4dc6-b471-6860da58467a tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847" status: 204 len: 0 microversion: 2.1 time: 0.131139 Nov 15 12:46:25.128372 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 453/934] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Nov 15 12:46:24 2021] DELETE /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 15 12:46:25.135803 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-71ee73bd-2d45-4f75-a2a4-126fc22167ee tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:25.137838 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-71ee73bd-2d45-4f75-a2a4-126fc22167ee tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:25.143324 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-71ee73bd-2d45-4f75-a2a4-126fc22167ee tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:25.143773 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-71ee73bd-2d45-4f75-a2a4-126fc22167ee tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:25.144567 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-71ee73bd-2d45-4f75-a2a4-126fc22167ee tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:25.144800 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e0055dbd-6777-4f33-b9fa-f7a9990b9032 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:25.145000 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-71ee73bd-2d45-4f75-a2a4-126fc22167ee tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:25.154700 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e0055dbd-6777-4f33-b9fa-f7a9990b9032 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:25.156811 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e0055dbd-6777-4f33-b9fa-f7a9990b9032 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:25.158069 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e0055dbd-6777-4f33-b9fa-f7a9990b9032 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1738 microversion: 2.20 time: 0.182381 Nov 15 12:46:25.170639 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 482/935] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:24 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:25.306235 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-71ee73bd-2d45-4f75-a2a4-126fc22167ee tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:25.314751 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-71ee73bd-2d45-4f75-a2a4-126fc22167ee tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847" status: 200 len: 1672 microversion: 2.1 time: 0.182921 Nov 15 12:46:25.315355 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 454/936] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:46:25 2021] GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847 => generated 1672 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:46:25.852429 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [req-85b0b964-c6b8-4660-93bf-ce738720167a req-c15454b7-7c45-4cb3-80c4-4659a07b9485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12e0ab18-a841-4228-bebb-1c5d1db6f7f6", "name": "network-vif-plugged", "status": "completed", "tag": "ffefc1bf-d747-45f6-8979-9a984c11ed67"}]} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:46:25.853967 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:46:25.853967 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: warnings.warn(msg) Nov 15 12:46:25.862068 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-85b0b964-c6b8-4660-93bf-ce738720167a req-c15454b7-7c45-4cb3-80c4-4659a07b9485 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:25.862532 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-85b0b964-c6b8-4660-93bf-ce738720167a req-c15454b7-7c45-4cb3-80c4-4659a07b9485 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:25.876457 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.compute.server_external_events [req-85b0b964-c6b8-4660-93bf-ce738720167a req-c15454b7-7c45-4cb3-80c4-4659a07b9485 service nova] Creating event network-vif-plugged:ffefc1bf-d747-45f6-8979-9a984c11ed67 for instance 12e0ab18-a841-4228-bebb-1c5d1db6f7f6 on hv-cinder-68088 Nov 15 12:46:25.884299 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [req-85b0b964-c6b8-4660-93bf-ce738720167a req-c15454b7-7c45-4cb3-80c4-4659a07b9485 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035346 Nov 15 12:46:25.885207 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 483/937] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:46:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 15 12:46:26.180567 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-951e4a8c-fadf-4dd9-b28b-74c2d7b6f666 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:26.181767 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-951e4a8c-fadf-4dd9-b28b-74c2d7b6f666 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:26.188522 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-951e4a8c-fadf-4dd9-b28b-74c2d7b6f666 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:26.188964 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-951e4a8c-fadf-4dd9-b28b-74c2d7b6f666 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:26.190119 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-951e4a8c-fadf-4dd9-b28b-74c2d7b6f666 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:26.190721 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-951e4a8c-fadf-4dd9-b28b-74c2d7b6f666 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:26.332865 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-dbee88a3-c509-4bb6-8e64-1425da6cc92e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:26.333659 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-dbee88a3-c509-4bb6-8e64-1425da6cc92e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:26.340699 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-dbee88a3-c509-4bb6-8e64-1425da6cc92e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:26.341145 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-dbee88a3-c509-4bb6-8e64-1425da6cc92e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:26.341929 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-dbee88a3-c509-4bb6-8e64-1425da6cc92e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:26.342544 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-dbee88a3-c509-4bb6-8e64-1425da6cc92e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:26.344798 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-951e4a8c-fadf-4dd9-b28b-74c2d7b6f666 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:26.354023 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-951e4a8c-fadf-4dd9-b28b-74c2d7b6f666 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:26.356374 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-951e4a8c-fadf-4dd9-b28b-74c2d7b6f666 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:26.357537 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-951e4a8c-fadf-4dd9-b28b-74c2d7b6f666 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1738 microversion: 2.20 time: 0.180834 Nov 15 12:46:26.368317 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 455/938] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:26 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:26.501758 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-dbee88a3-c509-4bb6-8e64-1425da6cc92e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:26.509502 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-dbee88a3-c509-4bb6-8e64-1425da6cc92e tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847" status: 200 len: 1672 microversion: 2.1 time: 0.180638 Nov 15 12:46:26.513154 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 484/939] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:46:26 2021] GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847 => generated 1672 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:46:27.376796 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-6cf14138-3da5-46ce-8cb6-25b48c2547ac tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:27.386465 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-6cf14138-3da5-46ce-8cb6-25b48c2547ac tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:27.393263 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6cf14138-3da5-46ce-8cb6-25b48c2547ac tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:27.394071 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6cf14138-3da5-46ce-8cb6-25b48c2547ac tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:27.395277 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6cf14138-3da5-46ce-8cb6-25b48c2547ac tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:27.396575 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6cf14138-3da5-46ce-8cb6-25b48c2547ac tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:27.532209 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-2b6fa286-e2db-484a-8192-c1e0a687ec86 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:27.533669 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-2b6fa286-e2db-484a-8192-c1e0a687ec86 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:27.541692 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2b6fa286-e2db-484a-8192-c1e0a687ec86 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:27.542827 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2b6fa286-e2db-484a-8192-c1e0a687ec86 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:27.543927 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2b6fa286-e2db-484a-8192-c1e0a687ec86 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:27.544477 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2b6fa286-e2db-484a-8192-c1e0a687ec86 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:27.572455 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-6cf14138-3da5-46ce-8cb6-25b48c2547ac tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:27.581546 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-6cf14138-3da5-46ce-8cb6-25b48c2547ac tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:27.583077 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-6cf14138-3da5-46ce-8cb6-25b48c2547ac tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:27.586830 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-6cf14138-3da5-46ce-8cb6-25b48c2547ac tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1738 microversion: 2.20 time: 0.212029 Nov 15 12:46:27.586830 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 456/940] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:27 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1738 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:27.752080 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-2b6fa286-e2db-484a-8192-c1e0a687ec86 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:27.765525 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-2b6fa286-e2db-484a-8192-c1e0a687ec86 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847" status: 200 len: 1672 microversion: 2.1 time: 0.238641 Nov 15 12:46:27.766248 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 485/941] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:46:27 2021] GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847 => generated 1672 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:46:28.166936 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-d64316d6-a5fa-4f46-9e0a-c33e6d7a8579 req-c26b2dcf-9f56-478c-a774-ea81f87b0ddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ceda11b-c435-4946-bbc9-f6ce1134e847", "name": "network-vif-deleted", "tag": "133aca31-05be-4a7b-9476-e523e5c06e27"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:46:28.169442 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:46:28.169442 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:46:28.194420 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-d64316d6-a5fa-4f46-9e0a-c33e6d7a8579 req-c26b2dcf-9f56-478c-a774-ea81f87b0ddd service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:28.195006 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-d64316d6-a5fa-4f46-9e0a-c33e6d7a8579 req-c26b2dcf-9f56-478c-a774-ea81f87b0ddd service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:28.221633 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-d64316d6-a5fa-4f46-9e0a-c33e6d7a8579 req-c26b2dcf-9f56-478c-a774-ea81f87b0ddd service nova] Creating event network-vif-deleted:133aca31-05be-4a7b-9476-e523e5c06e27 for instance 0ceda11b-c435-4946-bbc9-f6ce1134e847 on hv-cinder-68088 Nov 15 12:46:28.226994 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-d64316d6-a5fa-4f46-9e0a-c33e6d7a8579 req-c26b2dcf-9f56-478c-a774-ea81f87b0ddd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063591 Nov 15 12:46:28.227608 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 457/942] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:46:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:46:28.609334 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-da9c8c6e-2107-427b-ab4f-52a9d6dedf57 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:28.610582 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-da9c8c6e-2107-427b-ab4f-52a9d6dedf57 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:28.618941 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-da9c8c6e-2107-427b-ab4f-52a9d6dedf57 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:28.619663 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-da9c8c6e-2107-427b-ab4f-52a9d6dedf57 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:28.622014 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-da9c8c6e-2107-427b-ab4f-52a9d6dedf57 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:28.622649 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-da9c8c6e-2107-427b-ab4f-52a9d6dedf57 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:28.784473 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-58f27b30-4a7d-4a5d-b532-b468f83ca31c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:28.785167 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-58f27b30-4a7d-4a5d-b532-b468f83ca31c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:28.799568 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-58f27b30-4a7d-4a5d-b532-b468f83ca31c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:28.801712 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-58f27b30-4a7d-4a5d-b532-b468f83ca31c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:28.804373 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-58f27b30-4a7d-4a5d-b532-b468f83ca31c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:28.804978 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-58f27b30-4a7d-4a5d-b532-b468f83ca31c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:28.834420 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-da9c8c6e-2107-427b-ab4f-52a9d6dedf57 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:28.843737 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-da9c8c6e-2107-427b-ab4f-52a9d6dedf57 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:28.853640 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-da9c8c6e-2107-427b-ab4f-52a9d6dedf57 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:28.857615 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-da9c8c6e-2107-427b-ab4f-52a9d6dedf57 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1738 microversion: 2.20 time: 0.256007 Nov 15 12:46:28.858393 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 486/943] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:28 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1738 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 15 12:46:28.875478 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-58f27b30-4a7d-4a5d-b532-b468f83ca31c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:28.876299 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-58f27b30-4a7d-4a5d-b532-b468f83ca31c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:28.876897 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.objects.instance [None req-58f27b30-4a7d-4a5d-b532-b468f83ca31c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lazy-loading 'fault' on Instance uuid 0ceda11b-c435-4946-bbc9-f6ce1134e847 {{(pid=122568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 15 12:46:28.926726 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-58f27b30-4a7d-4a5d-b532-b468f83ca31c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4fb2fdbe754d13af2222261fddbbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91bd39e4f3b40f396370b06f870aeb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:28.936190 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-58f27b30-4a7d-4a5d-b532-b468f83ca31c tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847" status: 200 len: 1327 microversion: 2.1 time: 0.156113 Nov 15 12:46:28.937048 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 458/944] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:46:28 2021] GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847 => generated 1327 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:46:29.876707 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-f9570932-f1a6-4549-ac72-3527108a1455 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:29.878269 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-f9570932-f1a6-4549-ac72-3527108a1455 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:29.886888 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f9570932-f1a6-4549-ac72-3527108a1455 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:29.887287 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f9570932-f1a6-4549-ac72-3527108a1455 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:29.888492 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f9570932-f1a6-4549-ac72-3527108a1455 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:29.889151 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f9570932-f1a6-4549-ac72-3527108a1455 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:29.953910 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-f49c0949-0aa6-41a0-83f1-6a178eb74111 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:29.954498 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-f49c0949-0aa6-41a0-83f1-6a178eb74111 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:29.961610 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f49c0949-0aa6-41a0-83f1-6a178eb74111 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:29.962318 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f49c0949-0aa6-41a0-83f1-6a178eb74111 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:29.963331 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f49c0949-0aa6-41a0-83f1-6a178eb74111 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:29.963959 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f49c0949-0aa6-41a0-83f1-6a178eb74111 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:29.979218 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.wsgi [None req-f49c0949-0aa6-41a0-83f1-6a178eb74111 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] HTTP exception thrown: Instance 0ceda11b-c435-4946-bbc9-f6ce1134e847 could not be found. Nov 15 12:46:29.980129 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-f49c0949-0aa6-41a0-83f1-6a178eb74111 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Returning 404 to user: Instance 0ceda11b-c435-4946-bbc9-f6ce1134e847 could not be found. {{(pid=122568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:46:29.981176 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-f49c0949-0aa6-41a0-83f1-6a178eb74111 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847" status: 404 len: 111 microversion: 2.1 time: 0.030985 Nov 15 12:46:29.981739 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 459/945] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:46:29 2021] GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 15 12:46:29.990574 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-e986676a-148a-4ae3-95bf-721a8bde409d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '.version_select at 0x7f131b238040>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:30.013504 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-e986676a-148a-4ae3-95bf-721a8bde409d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1588588195" status: 202 len: 0 microversion: 2.1 time: 0.026257 Nov 15 12:46:30.014302 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 460/946] 10.222.0.43 () {58 vars in 1220 bytes} [Mon Nov 15 12:46:29 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1588588195 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:46:30.070363 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-f9570932-f1a6-4549-ac72-3527108a1455 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:30.082202 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-f9570932-f1a6-4549-ac72-3527108a1455 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:30.083875 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-f9570932-f1a6-4549-ac72-3527108a1455 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:30.085189 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-f9570932-f1a6-4549-ac72-3527108a1455 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1738 microversion: 2.20 time: 0.212345 Nov 15 12:46:30.086304 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 487/947] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:29 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1738 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:31.109495 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-acb486fd-ceed-4d97-8895-53fe6becacd3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:31.111648 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-acb486fd-ceed-4d97-8895-53fe6becacd3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:31.130563 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-acb486fd-ceed-4d97-8895-53fe6becacd3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:31.131891 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-acb486fd-ceed-4d97-8895-53fe6becacd3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:31.133242 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-acb486fd-ceed-4d97-8895-53fe6becacd3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:31.133934 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-acb486fd-ceed-4d97-8895-53fe6becacd3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:31.345334 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-acb486fd-ceed-4d97-8895-53fe6becacd3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:31.354299 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-acb486fd-ceed-4d97-8895-53fe6becacd3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:31.355981 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-acb486fd-ceed-4d97-8895-53fe6becacd3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:31.357194 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-acb486fd-ceed-4d97-8895-53fe6becacd3 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1738 microversion: 2.20 time: 0.255772 Nov 15 12:46:31.361802 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 461/948] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:31 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1738 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:32.380556 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-35433f4c-e21c-427f-bc74-6665ceb735a0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:32.381163 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-35433f4c-e21c-427f-bc74-6665ceb735a0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:32.392447 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-35433f4c-e21c-427f-bc74-6665ceb735a0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:32.392889 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-35433f4c-e21c-427f-bc74-6665ceb735a0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:32.402326 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-35433f4c-e21c-427f-bc74-6665ceb735a0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:32.403133 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-35433f4c-e21c-427f-bc74-6665ceb735a0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:32.579188 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-35433f4c-e21c-427f-bc74-6665ceb735a0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:32.588756 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-35433f4c-e21c-427f-bc74-6665ceb735a0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:32.591667 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-35433f4c-e21c-427f-bc74-6665ceb735a0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:32.593093 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-35433f4c-e21c-427f-bc74-6665ceb735a0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1738 microversion: 2.20 time: 0.216332 Nov 15 12:46:32.594426 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 488/949] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:32 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:33.424745 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-e7105c0a-96ba-4e12-abcf-3fcebb2d430d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:33.425869 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-e7105c0a-96ba-4e12-abcf-3fcebb2d430d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:33.432444 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e7105c0a-96ba-4e12-abcf-3fcebb2d430d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:33.433504 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e7105c0a-96ba-4e12-abcf-3fcebb2d430d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:33.434413 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e7105c0a-96ba-4e12-abcf-3fcebb2d430d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:33.434864 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e7105c0a-96ba-4e12-abcf-3fcebb2d430d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:33.450222 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.wsgi [None req-e7105c0a-96ba-4e12-abcf-3fcebb2d430d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] HTTP exception thrown: Instance 0ceda11b-c435-4946-bbc9-f6ce1134e847 could not be found. Nov 15 12:46:33.450849 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-e7105c0a-96ba-4e12-abcf-3fcebb2d430d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Returning 404 to user: Instance 0ceda11b-c435-4946-bbc9-f6ce1134e847 could not be found. {{(pid=122568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:46:33.451670 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-e7105c0a-96ba-4e12-abcf-3fcebb2d430d tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847" status: 404 len: 111 microversion: 2.1 time: 0.032751 Nov 15 12:46:33.452998 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 462/950] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Nov 15 12:46:33 2021] DELETE /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 15 12:46:33.460457 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-25fca3e3-9108-4c00-86b0-12fb77e33fa8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:33.461194 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-25fca3e3-9108-4c00-86b0-12fb77e33fa8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: 0ceda11b-c435-4946-bbc9-f6ce1134e847] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:33.468104 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-25fca3e3-9108-4c00-86b0-12fb77e33fa8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:33.468778 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-25fca3e3-9108-4c00-86b0-12fb77e33fa8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:33.469876 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-25fca3e3-9108-4c00-86b0-12fb77e33fa8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:33.470320 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-25fca3e3-9108-4c00-86b0-12fb77e33fa8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:33.487592 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.wsgi [None req-25fca3e3-9108-4c00-86b0-12fb77e33fa8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] HTTP exception thrown: Instance 0ceda11b-c435-4946-bbc9-f6ce1134e847 could not be found. Nov 15 12:46:33.488484 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-25fca3e3-9108-4c00-86b0-12fb77e33fa8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Returning 404 to user: Instance 0ceda11b-c435-4946-bbc9-f6ce1134e847 could not be found. {{(pid=122567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:46:33.489508 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-25fca3e3-9108-4c00-86b0-12fb77e33fa8 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847" status: 404 len: 111 microversion: 2.1 time: 0.032984 Nov 15 12:46:33.493634 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 489/951] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:46:33 2021] GET /compute/v2.1/servers/0ceda11b-c435-4946-bbc9-f6ce1134e847 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 15 12:46:33.613216 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-92c64267-e485-419c-8185-f4bf673c3d2b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:33.613816 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-92c64267-e485-419c-8185-f4bf673c3d2b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:33.620041 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-92c64267-e485-419c-8185-f4bf673c3d2b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:33.620546 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-92c64267-e485-419c-8185-f4bf673c3d2b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:33.621544 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-92c64267-e485-419c-8185-f4bf673c3d2b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:33.623711 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-92c64267-e485-419c-8185-f4bf673c3d2b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:33.778613 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-92c64267-e485-419c-8185-f4bf673c3d2b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:33.790868 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-92c64267-e485-419c-8185-f4bf673c3d2b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:33.793893 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-92c64267-e485-419c-8185-f4bf673c3d2b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:33.795601 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-92c64267-e485-419c-8185-f4bf673c3d2b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1738 microversion: 2.20 time: 0.186152 Nov 15 12:46:33.796160 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 463/952] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:33 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:34.639756 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-20466c95-b887-4bb5-a486-58885f5ad6e7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:34.640851 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-20466c95-b887-4bb5-a486-58885f5ad6e7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:34.647617 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-20466c95-b887-4bb5-a486-58885f5ad6e7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:34.648276 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-20466c95-b887-4bb5-a486-58885f5ad6e7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:34.649116 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-20466c95-b887-4bb5-a486-58885f5ad6e7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:34.649550 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-20466c95-b887-4bb5-a486-58885f5ad6e7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:34.664814 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.wsgi [None req-20466c95-b887-4bb5-a486-58885f5ad6e7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] HTTP exception thrown: Instance a107064a-524f-4964-97da-84d2b50d422d could not be found. Nov 15 12:46:34.665580 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-20466c95-b887-4bb5-a486-58885f5ad6e7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Returning 404 to user: Instance a107064a-524f-4964-97da-84d2b50d422d could not be found. {{(pid=122567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:46:34.666539 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-20466c95-b887-4bb5-a486-58885f5ad6e7 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 404 len: 111 microversion: 2.1 time: 0.030476 Nov 15 12:46:34.668598 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 490/953] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Nov 15 12:46:34 2021] DELETE /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 15 12:46:34.677169 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-2617d70b-642d-461f-8ad8-9717cfc21f04 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:34.677763 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-2617d70b-642d-461f-8ad8-9717cfc21f04 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] [instance: a107064a-524f-4964-97da-84d2b50d422d] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:34.684978 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2617d70b-642d-461f-8ad8-9717cfc21f04 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:34.685540 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2617d70b-642d-461f-8ad8-9717cfc21f04 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:34.686246 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2617d70b-642d-461f-8ad8-9717cfc21f04 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:34.686671 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-2617d70b-642d-461f-8ad8-9717cfc21f04 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:34.703441 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.wsgi [None req-2617d70b-642d-461f-8ad8-9717cfc21f04 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] HTTP exception thrown: Instance a107064a-524f-4964-97da-84d2b50d422d could not be found. Nov 15 12:46:34.704047 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-2617d70b-642d-461f-8ad8-9717cfc21f04 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] Returning 404 to user: Instance a107064a-524f-4964-97da-84d2b50d422d could not be found. {{(pid=122568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:46:34.704880 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-2617d70b-642d-461f-8ad8-9717cfc21f04 tempest-AttachVolumeTestJSON-974928467 tempest-AttachVolumeTestJSON-974928467-project] 10.222.0.43 "GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d" status: 404 len: 111 microversion: 2.1 time: 0.031627 Nov 15 12:46:34.705445 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 464/954] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:46:34 2021] GET /compute/v2.1/servers/a107064a-524f-4964-97da-84d2b50d422d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 15 12:46:34.814625 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-6e655182-0167-43c1-8dd2-88999a4d72ea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:34.815255 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-6e655182-0167-43c1-8dd2-88999a4d72ea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:34.821062 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6e655182-0167-43c1-8dd2-88999a4d72ea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:34.821501 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6e655182-0167-43c1-8dd2-88999a4d72ea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:34.822588 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6e655182-0167-43c1-8dd2-88999a4d72ea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:34.823041 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6e655182-0167-43c1-8dd2-88999a4d72ea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:34.965315 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-6e655182-0167-43c1-8dd2-88999a4d72ea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:34.973247 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-6e655182-0167-43c1-8dd2-88999a4d72ea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:34.974863 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-6e655182-0167-43c1-8dd2-88999a4d72ea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:34.976095 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-6e655182-0167-43c1-8dd2-88999a4d72ea tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1738 microversion: 2.20 time: 0.165739 Nov 15 12:46:34.976735 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 491/955] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:34 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:35.995727 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-1a61f873-0428-4240-83e5-0b17e29a1e42 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:35.996408 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-1a61f873-0428-4240-83e5-0b17e29a1e42 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:36.003113 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1a61f873-0428-4240-83e5-0b17e29a1e42 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:36.003642 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1a61f873-0428-4240-83e5-0b17e29a1e42 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:36.004425 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1a61f873-0428-4240-83e5-0b17e29a1e42 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:36.004858 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1a61f873-0428-4240-83e5-0b17e29a1e42 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:36.393678 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-1a61f873-0428-4240-83e5-0b17e29a1e42 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:36.402147 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-1a61f873-0428-4240-83e5-0b17e29a1e42 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:36.403915 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-1a61f873-0428-4240-83e5-0b17e29a1e42 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:36.405152 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-1a61f873-0428-4240-83e5-0b17e29a1e42 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1720 microversion: 2.20 time: 0.413568 Nov 15 12:46:36.405795 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 465/956] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:35 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1720 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:37.424273 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-503f1643-0436-458b-8e64-66048c1d62a9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:37.424877 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-503f1643-0436-458b-8e64-66048c1d62a9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:37.431849 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-503f1643-0436-458b-8e64-66048c1d62a9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:37.432293 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-503f1643-0436-458b-8e64-66048c1d62a9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:37.433727 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-503f1643-0436-458b-8e64-66048c1d62a9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:37.434349 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-503f1643-0436-458b-8e64-66048c1d62a9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:37.569570 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-503f1643-0436-458b-8e64-66048c1d62a9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:37.577597 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-503f1643-0436-458b-8e64-66048c1d62a9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:37.579167 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-503f1643-0436-458b-8e64-66048c1d62a9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:37.580337 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-503f1643-0436-458b-8e64-66048c1d62a9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1720 microversion: 2.20 time: 0.159943 Nov 15 12:46:37.580907 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 492/957] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:37 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 15 12:46:38.601199 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-7baa13ce-9893-46b2-a99a-0cadd190ebda tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:38.601905 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-7baa13ce-9893-46b2-a99a-0cadd190ebda tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:38.608944 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7baa13ce-9893-46b2-a99a-0cadd190ebda tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:38.610164 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7baa13ce-9893-46b2-a99a-0cadd190ebda tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:38.610294 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7baa13ce-9893-46b2-a99a-0cadd190ebda tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:38.615546 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7baa13ce-9893-46b2-a99a-0cadd190ebda tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:38.752614 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-7baa13ce-9893-46b2-a99a-0cadd190ebda tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:38.760608 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-7baa13ce-9893-46b2-a99a-0cadd190ebda tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:38.762199 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-7baa13ce-9893-46b2-a99a-0cadd190ebda tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:38.763559 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-7baa13ce-9893-46b2-a99a-0cadd190ebda tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1663 microversion: 2.20 time: 0.168881 Nov 15 12:46:38.764786 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 466/958] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:38 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1663 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:38.784689 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-1b2f3241-9443-4fe4-9275-cfa083ca6135 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1f9eab0-84d2-4175-bb2e-54cbbfd5f9d6"}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:46:38.785666 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-1b2f3241-9443-4fe4-9275-cfa083ca6135 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:38.792105 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1b2f3241-9443-4fe4-9275-cfa083ca6135 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:38.792739 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1b2f3241-9443-4fe4-9275-cfa083ca6135 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:38.793548 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1b2f3241-9443-4fe4-9275-cfa083ca6135 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:38.794170 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1b2f3241-9443-4fe4-9275-cfa083ca6135 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:39.073272 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-1b2f3241-9443-4fe4-9275-cfa083ca6135 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.292335 Nov 15 12:46:39.074341 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 493/959] 10.222.0.43 () {62 vars in 1363 bytes} [Mon Nov 15 12:46:38 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/os-volume_attachments => generated 188 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 15 12:46:39.189558 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-ef15c980-3c2e-4cb6-856c-1b30e379e209 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:39.190045 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-ef15c980-3c2e-4cb6-856c-1b30e379e209 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:39.195957 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ef15c980-3c2e-4cb6-856c-1b30e379e209 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:39.196636 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ef15c980-3c2e-4cb6-856c-1b30e379e209 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:39.197425 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ef15c980-3c2e-4cb6-856c-1b30e379e209 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:39.197857 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ef15c980-3c2e-4cb6-856c-1b30e379e209 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:39.465108 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-ef15c980-3c2e-4cb6-856c-1b30e379e209 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "DELETE /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/os-volume_attachments/c1f9eab0-84d2-4175-bb2e-54cbbfd5f9d6" status: 202 len: 0 microversion: 2.20 time: 0.279194 Nov 15 12:46:39.467092 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 467/960] 10.222.0.43 () {60 vars in 1456 bytes} [Mon Nov 15 12:46:39 2021] DELETE /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/os-volume_attachments/c1f9eab0-84d2-4175-bb2e-54cbbfd5f9d6 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 15 12:46:39.527845 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-6f86d47c-72c5-492a-bc07-bd0a08b29cc9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:46:39.528528 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-6f86d47c-72c5-492a-bc07-bd0a08b29cc9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:39.534391 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6f86d47c-72c5-492a-bc07-bd0a08b29cc9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:39.534927 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6f86d47c-72c5-492a-bc07-bd0a08b29cc9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:39.536239 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6f86d47c-72c5-492a-bc07-bd0a08b29cc9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:39.536680 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6f86d47c-72c5-492a-bc07-bd0a08b29cc9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:39.627968 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-6f86d47c-72c5-492a-bc07-bd0a08b29cc9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action" status: 202 len: 0 microversion: 2.20 time: 0.104708 Nov 15 12:46:39.628852 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 494/961] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Nov 15 12:46:39 2021] POST /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 15 12:46:39.637197 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-eeafa6b9-cc94-46c8-9f8e-5e1928f6366f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:39.638390 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-eeafa6b9-cc94-46c8-9f8e-5e1928f6366f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:39.646555 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-eeafa6b9-cc94-46c8-9f8e-5e1928f6366f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:39.647272 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-eeafa6b9-cc94-46c8-9f8e-5e1928f6366f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:39.648213 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-eeafa6b9-cc94-46c8-9f8e-5e1928f6366f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:39.648794 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-eeafa6b9-cc94-46c8-9f8e-5e1928f6366f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:39.831006 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-eeafa6b9-cc94-46c8-9f8e-5e1928f6366f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:39.840679 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-eeafa6b9-cc94-46c8-9f8e-5e1928f6366f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:39.848407 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [req-3936bba1-7411-447f-a2f8-4e8788e17434 req-99403505-c703-4f3d-a639-7104d09d863e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12e0ab18-a841-4228-bebb-1c5d1db6f7f6", "name": "network-vif-unplugged", "status": "completed", "tag": "ffefc1bf-d747-45f6-8979-9a984c11ed67"}]} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:46:39.849002 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-eeafa6b9-cc94-46c8-9f8e-5e1928f6366f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:39.849774 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-eeafa6b9-cc94-46c8-9f8e-5e1928f6366f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1671 microversion: 2.20 time: 0.216696 Nov 15 12:46:39.850275 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 468/962] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:39 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1671 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:39.850945 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:46:39.850945 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: warnings.warn(msg) Nov 15 12:46:39.863804 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-3936bba1-7411-447f-a2f8-4e8788e17434 req-99403505-c703-4f3d-a639-7104d09d863e service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:39.864323 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-3936bba1-7411-447f-a2f8-4e8788e17434 req-99403505-c703-4f3d-a639-7104d09d863e service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:39.877892 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.compute.server_external_events [req-3936bba1-7411-447f-a2f8-4e8788e17434 req-99403505-c703-4f3d-a639-7104d09d863e service nova] Unable to find a host for instance 12e0ab18-a841-4228-bebb-1c5d1db6f7f6. Dropping event network-vif-unplugged {{(pid=122567) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 15 12:46:39.879102 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [req-3936bba1-7411-447f-a2f8-4e8788e17434 req-99403505-c703-4f3d-a639-7104d09d863e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035482 Nov 15 12:46:39.880139 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 495/963] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:46:39 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 15 12:46:40.725992 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-6db331bb-cb2b-4cf4-81b1-398dda10ff8d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2132952244", "imageRef": "3cc21e2c-27da-4266-be76-369023341c16", "flavorRef": "452", "networks": [{"uuid": "b5e792a7-3bc7-401c-8890-d6bf3bed54f7"}]}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:46:40.781805 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.network.neutron [None req-6db331bb-cb2b-4cf4-81b1-398dda10ff8d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] validate_networks() for [('b5e792a7-3bc7-401c-8890-d6bf3bed54f7', None, None, None, None, None)] {{(pid=122568) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 15 12:46:40.869700 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-ea35ca23-fbf9-47f4-b990-ec349f9292b2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:40.871778 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-ea35ca23-fbf9-47f4-b990-ec349f9292b2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:40.878068 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ea35ca23-fbf9-47f4-b990-ec349f9292b2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:40.878520 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ea35ca23-fbf9-47f4-b990-ec349f9292b2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:40.879340 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ea35ca23-fbf9-47f4-b990-ec349f9292b2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:40.879776 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ea35ca23-fbf9-47f4-b990-ec349f9292b2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:41.177981 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-ea35ca23-fbf9-47f4-b990-ec349f9292b2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:41.186857 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-ea35ca23-fbf9-47f4-b990-ec349f9292b2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:41.188360 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-ea35ca23-fbf9-47f4-b990-ec349f9292b2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:41.189527 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-ea35ca23-fbf9-47f4-b990-ec349f9292b2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1729 microversion: 2.20 time: 0.323774 Nov 15 12:46:41.190253 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 496/964] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:40 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1729 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:41.241994 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-6db331bb-cb2b-4cf4-81b1-398dda10ff8d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Flavor limits 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 15 12:46:41.242415 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-6db331bb-cb2b-4cf4-81b1-398dda10ff8d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Image limits 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 15 12:46:41.242912 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-6db331bb-cb2b-4cf4-81b1-398dda10ff8d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Flavor pref 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 15 12:46:41.243513 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-6db331bb-cb2b-4cf4-81b1-398dda10ff8d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Image pref 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 15 12:46:41.243920 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-6db331bb-cb2b-4cf4-81b1-398dda10ff8d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 15 12:46:41.254124 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6db331bb-cb2b-4cf4-81b1-398dda10ff8d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:41.254946 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6db331bb-cb2b-4cf4-81b1-398dda10ff8d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:41.256040 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6db331bb-cb2b-4cf4-81b1-398dda10ff8d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:41.256714 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6db331bb-cb2b-4cf4-81b1-398dda10ff8d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:41.282880 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-6db331bb-cb2b-4cf4-81b1-398dda10ff8d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Getting quotas for project 8b023f637e184e67bccf0ed11a6a802d. Resources: {'cores', 'ram', 'instances'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:46:41.287561 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-6db331bb-cb2b-4cf4-81b1-398dda10ff8d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Getting quotas for user ca6612e1905c4e70b39aaa552b9de730 and project 8b023f637e184e67bccf0ed11a6a802d. Resources: {'cores', 'ram', 'instances'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:46:41.299854 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-6db331bb-cb2b-4cf4-81b1-398dda10ff8d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Going to run 1 instances... {{(pid=122568) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 15 12:46:41.302359 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-6db331bb-cb2b-4cf4-81b1-398dda10ff8d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: fb106071-4d21-44c8-b21d-653a55a214ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3cc21e2c-27da-4266-be76-369023341c16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 15 12:46:41.354040 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-6db331bb-cb2b-4cf4-81b1-398dda10ff8d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.687885 Nov 15 12:46:41.356248 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 469/965] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Nov 15 12:46:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 15 12:46:41.369220 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-373a1c31-867e-4b93-8032-d46953ad838f tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:41.369921 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-373a1c31-867e-4b93-8032-d46953ad838f tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: fb106071-4d21-44c8-b21d-653a55a214ca] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:41.521797 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-373a1c31-867e-4b93-8032-d46953ad838f tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:41.529892 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-373a1c31-867e-4b93-8032-d46953ad838f tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca" status: 200 len: 1218 microversion: 2.1 time: 0.164366 Nov 15 12:46:41.531028 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 497/966] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:46:41 2021] GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca => generated 1218 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:46:42.208889 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-e025740f-8b06-4ed9-8445-4a88bc2c253b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:42.209478 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-e025740f-8b06-4ed9-8445-4a88bc2c253b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:42.217136 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e025740f-8b06-4ed9-8445-4a88bc2c253b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:42.217573 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e025740f-8b06-4ed9-8445-4a88bc2c253b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:42.218346 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e025740f-8b06-4ed9-8445-4a88bc2c253b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:42.218793 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e025740f-8b06-4ed9-8445-4a88bc2c253b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:42.367734 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-e025740f-8b06-4ed9-8445-4a88bc2c253b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:42.376892 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-e025740f-8b06-4ed9-8445-4a88bc2c253b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:42.378657 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-e025740f-8b06-4ed9-8445-4a88bc2c253b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:42.380186 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-e025740f-8b06-4ed9-8445-4a88bc2c253b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1729 microversion: 2.20 time: 0.175048 Nov 15 12:46:42.380889 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 470/967] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:42 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:42.547934 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-61b3cf49-2f6d-4d05-9ad7-02adc464839a tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:42.548568 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-61b3cf49-2f6d-4d05-9ad7-02adc464839a tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: fb106071-4d21-44c8-b21d-653a55a214ca] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:42.555309 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-61b3cf49-2f6d-4d05-9ad7-02adc464839a tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:42.555753 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-61b3cf49-2f6d-4d05-9ad7-02adc464839a tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:42.556546 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-61b3cf49-2f6d-4d05-9ad7-02adc464839a tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:42.557005 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-61b3cf49-2f6d-4d05-9ad7-02adc464839a tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:42.623653 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-61b3cf49-2f6d-4d05-9ad7-02adc464839a tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:42.631142 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-61b3cf49-2f6d-4d05-9ad7-02adc464839a tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca" status: 200 len: 1270 microversion: 2.1 time: 0.087067 Nov 15 12:46:42.631718 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 498/968] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:46:42 2021] GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:46:43.398932 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-f41b1922-5b57-4bac-b70c-11e1b7f446ab tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:43.399535 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-f41b1922-5b57-4bac-b70c-11e1b7f446ab tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:43.408792 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f41b1922-5b57-4bac-b70c-11e1b7f446ab tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:43.409631 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f41b1922-5b57-4bac-b70c-11e1b7f446ab tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:43.410518 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f41b1922-5b57-4bac-b70c-11e1b7f446ab tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:43.410969 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f41b1922-5b57-4bac-b70c-11e1b7f446ab tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:43.553432 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-f41b1922-5b57-4bac-b70c-11e1b7f446ab tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:43.563056 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-f41b1922-5b57-4bac-b70c-11e1b7f446ab tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:43.564549 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-f41b1922-5b57-4bac-b70c-11e1b7f446ab tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:43.565713 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-f41b1922-5b57-4bac-b70c-11e1b7f446ab tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1729 microversion: 2.20 time: 0.170554 Nov 15 12:46:43.566271 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 471/969] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:43 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:43.652536 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-ed29e781-4c5f-4a2e-b215-0a63c871cfac tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:43.653670 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-ed29e781-4c5f-4a2e-b215-0a63c871cfac tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: fb106071-4d21-44c8-b21d-653a55a214ca] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:43.661481 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ed29e781-4c5f-4a2e-b215-0a63c871cfac tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:43.661929 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ed29e781-4c5f-4a2e-b215-0a63c871cfac tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:43.662737 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ed29e781-4c5f-4a2e-b215-0a63c871cfac tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:43.663198 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ed29e781-4c5f-4a2e-b215-0a63c871cfac tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:43.735262 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-ed29e781-4c5f-4a2e-b215-0a63c871cfac tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:43.743107 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-ed29e781-4c5f-4a2e-b215-0a63c871cfac tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca" status: 200 len: 1270 microversion: 2.1 time: 0.096427 Nov 15 12:46:43.743687 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 499/970] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:46:43 2021] GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca => generated 1270 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:46:44.584312 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-9d439e85-a3d4-48b5-971d-24a7808be4da tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:44.584910 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-9d439e85-a3d4-48b5-971d-24a7808be4da tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:44.591788 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9d439e85-a3d4-48b5-971d-24a7808be4da tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:44.592254 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9d439e85-a3d4-48b5-971d-24a7808be4da tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:44.593077 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9d439e85-a3d4-48b5-971d-24a7808be4da tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:44.593506 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9d439e85-a3d4-48b5-971d-24a7808be4da tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:44.743078 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-9d439e85-a3d4-48b5-971d-24a7808be4da tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:44.751508 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-9d439e85-a3d4-48b5-971d-24a7808be4da tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:44.753001 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-9d439e85-a3d4-48b5-971d-24a7808be4da tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:44.754172 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-9d439e85-a3d4-48b5-971d-24a7808be4da tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1729 microversion: 2.20 time: 0.173615 Nov 15 12:46:44.754730 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 472/971] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:44 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:44.763739 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-3afeca2a-1065-4ea3-8517-b975dd0bd2e7 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:44.764476 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-3afeca2a-1065-4ea3-8517-b975dd0bd2e7 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: fb106071-4d21-44c8-b21d-653a55a214ca] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:44.770984 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3afeca2a-1065-4ea3-8517-b975dd0bd2e7 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:44.771678 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3afeca2a-1065-4ea3-8517-b975dd0bd2e7 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:44.772501 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3afeca2a-1065-4ea3-8517-b975dd0bd2e7 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:44.773319 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3afeca2a-1065-4ea3-8517-b975dd0bd2e7 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:44.835579 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-3afeca2a-1065-4ea3-8517-b975dd0bd2e7 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:44.843911 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-3afeca2a-1065-4ea3-8517-b975dd0bd2e7 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca" status: 200 len: 1270 microversion: 2.1 time: 0.086527 Nov 15 12:46:44.844631 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 500/972] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:46:44 2021] GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:46:45.773160 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-33ec129e-6376-4c9c-941f-879447d1fec0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:45.773838 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-33ec129e-6376-4c9c-941f-879447d1fec0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:45.780597 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-33ec129e-6376-4c9c-941f-879447d1fec0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:45.781028 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-33ec129e-6376-4c9c-941f-879447d1fec0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:45.781779 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-33ec129e-6376-4c9c-941f-879447d1fec0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:45.782193 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-33ec129e-6376-4c9c-941f-879447d1fec0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:45.861210 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-8c6af16d-203e-4ef7-b535-063503b68d83 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:45.861992 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-8c6af16d-203e-4ef7-b535-063503b68d83 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: fb106071-4d21-44c8-b21d-653a55a214ca] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:45.868064 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8c6af16d-203e-4ef7-b535-063503b68d83 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:45.868502 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8c6af16d-203e-4ef7-b535-063503b68d83 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:45.869270 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8c6af16d-203e-4ef7-b535-063503b68d83 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:45.869731 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8c6af16d-203e-4ef7-b535-063503b68d83 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:45.945193 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-8c6af16d-203e-4ef7-b535-063503b68d83 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:45.954558 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-33ec129e-6376-4c9c-941f-879447d1fec0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:45.955156 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-8c6af16d-203e-4ef7-b535-063503b68d83 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca" status: 200 len: 1270 microversion: 2.1 time: 0.097149 Nov 15 12:46:45.955966 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 501/973] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:46:45 2021] GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:46:45.963346 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-33ec129e-6376-4c9c-941f-879447d1fec0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:45.964798 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-33ec129e-6376-4c9c-941f-879447d1fec0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:45.965950 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-33ec129e-6376-4c9c-941f-879447d1fec0 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1729 microversion: 2.20 time: 0.196488 Nov 15 12:46:45.966500 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 473/974] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:45 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1729 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:46.973371 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-5ea6c4aa-8678-4205-84ac-2355bcbdd280 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:46.974006 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-5ea6c4aa-8678-4205-84ac-2355bcbdd280 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: fb106071-4d21-44c8-b21d-653a55a214ca] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:46.981170 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5ea6c4aa-8678-4205-84ac-2355bcbdd280 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:46.981953 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5ea6c4aa-8678-4205-84ac-2355bcbdd280 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:46.982984 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5ea6c4aa-8678-4205-84ac-2355bcbdd280 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:46.983592 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5ea6c4aa-8678-4205-84ac-2355bcbdd280 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:46.985146 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-34ac29f6-1bb2-4432-9c15-b6467a0e1d11 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:46.985848 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-34ac29f6-1bb2-4432-9c15-b6467a0e1d11 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:46.993592 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-34ac29f6-1bb2-4432-9c15-b6467a0e1d11 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:46.994384 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-34ac29f6-1bb2-4432-9c15-b6467a0e1d11 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:46.995631 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-34ac29f6-1bb2-4432-9c15-b6467a0e1d11 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:46.996289 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-34ac29f6-1bb2-4432-9c15-b6467a0e1d11 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:47.084409 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-5ea6c4aa-8678-4205-84ac-2355bcbdd280 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:47.096662 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-5ea6c4aa-8678-4205-84ac-2355bcbdd280 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca" status: 200 len: 1270 microversion: 2.1 time: 0.126833 Nov 15 12:46:47.109509 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 502/975] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:46:46 2021] GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca => generated 1270 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:46:47.193808 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-34ac29f6-1bb2-4432-9c15-b6467a0e1d11 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:47.221956 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-34ac29f6-1bb2-4432-9c15-b6467a0e1d11 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:47.223592 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-34ac29f6-1bb2-4432-9c15-b6467a0e1d11 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:47.224727 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-34ac29f6-1bb2-4432-9c15-b6467a0e1d11 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1729 microversion: 2.20 time: 0.243767 Nov 15 12:46:47.225301 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 474/976] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:46 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1729 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 15 12:46:48.119503 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-adf58d78-240a-44ae-95ff-cf3ab992d1e4 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:48.121459 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-adf58d78-240a-44ae-95ff-cf3ab992d1e4 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: fb106071-4d21-44c8-b21d-653a55a214ca] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:48.127633 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-adf58d78-240a-44ae-95ff-cf3ab992d1e4 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:48.128083 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-adf58d78-240a-44ae-95ff-cf3ab992d1e4 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:48.128940 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-adf58d78-240a-44ae-95ff-cf3ab992d1e4 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:48.129374 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-adf58d78-240a-44ae-95ff-cf3ab992d1e4 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:48.193739 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-adf58d78-240a-44ae-95ff-cf3ab992d1e4 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:48.201618 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-adf58d78-240a-44ae-95ff-cf3ab992d1e4 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca" status: 200 len: 1270 microversion: 2.1 time: 0.087442 Nov 15 12:46:48.205240 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 503/977] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:46:48 2021] GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:46:48.245945 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-e6343e69-693a-43e5-8677-e1d9e9934847 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:48.246859 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-e6343e69-693a-43e5-8677-e1d9e9934847 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:48.253460 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e6343e69-693a-43e5-8677-e1d9e9934847 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:48.253977 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e6343e69-693a-43e5-8677-e1d9e9934847 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:48.255022 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e6343e69-693a-43e5-8677-e1d9e9934847 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:48.255482 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e6343e69-693a-43e5-8677-e1d9e9934847 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:48.417320 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-e6343e69-693a-43e5-8677-e1d9e9934847 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:48.426316 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-e6343e69-693a-43e5-8677-e1d9e9934847 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:48.427935 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-e6343e69-693a-43e5-8677-e1d9e9934847 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:48.429234 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-e6343e69-693a-43e5-8677-e1d9e9934847 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1729 microversion: 2.20 time: 0.189106 Nov 15 12:46:48.429890 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 475/978] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:48 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:49.218688 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-82f05bd3-869b-4710-b617-9628937a52e8 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:49.219524 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-82f05bd3-869b-4710-b617-9628937a52e8 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: fb106071-4d21-44c8-b21d-653a55a214ca] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:49.226349 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-82f05bd3-869b-4710-b617-9628937a52e8 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:49.226820 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-82f05bd3-869b-4710-b617-9628937a52e8 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:49.227622 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-82f05bd3-869b-4710-b617-9628937a52e8 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:49.228057 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-82f05bd3-869b-4710-b617-9628937a52e8 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:49.292321 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-82f05bd3-869b-4710-b617-9628937a52e8 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:49.301252 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-82f05bd3-869b-4710-b617-9628937a52e8 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca" status: 200 len: 1270 microversion: 2.1 time: 0.086175 Nov 15 12:46:49.302124 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 504/979] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:46:49 2021] GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:46:49.448236 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-b684e49f-8a2c-48bb-b124-58ca2bfe50c2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:49.448863 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-b684e49f-8a2c-48bb-b124-58ca2bfe50c2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:49.455243 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b684e49f-8a2c-48bb-b124-58ca2bfe50c2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:49.455630 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b684e49f-8a2c-48bb-b124-58ca2bfe50c2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:49.456402 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b684e49f-8a2c-48bb-b124-58ca2bfe50c2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:49.456834 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b684e49f-8a2c-48bb-b124-58ca2bfe50c2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:49.606497 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-b684e49f-8a2c-48bb-b124-58ca2bfe50c2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:49.615243 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-b684e49f-8a2c-48bb-b124-58ca2bfe50c2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:49.617217 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-b684e49f-8a2c-48bb-b124-58ca2bfe50c2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:49.618714 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-b684e49f-8a2c-48bb-b124-58ca2bfe50c2 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1729 microversion: 2.20 time: 0.174572 Nov 15 12:46:49.630975 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 476/980] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:49 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:50.317893 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-f78ab554-4e4e-4984-be7f-ce231f9a1111 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:50.318521 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-f78ab554-4e4e-4984-be7f-ce231f9a1111 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: fb106071-4d21-44c8-b21d-653a55a214ca] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:50.327671 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f78ab554-4e4e-4984-be7f-ce231f9a1111 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:50.328217 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f78ab554-4e4e-4984-be7f-ce231f9a1111 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:50.329170 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f78ab554-4e4e-4984-be7f-ce231f9a1111 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:50.329889 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-f78ab554-4e4e-4984-be7f-ce231f9a1111 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:50.395404 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-f78ab554-4e4e-4984-be7f-ce231f9a1111 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:50.403868 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-f78ab554-4e4e-4984-be7f-ce231f9a1111 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca" status: 200 len: 1270 microversion: 2.1 time: 0.089536 Nov 15 12:46:50.404457 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 505/981] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:46:50 2021] GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:46:50.639236 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-27c06097-0f78-4684-9bb3-665b933e286f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:50.639872 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-27c06097-0f78-4684-9bb3-665b933e286f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:50.646221 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-27c06097-0f78-4684-9bb3-665b933e286f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:50.646661 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-27c06097-0f78-4684-9bb3-665b933e286f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:50.647457 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-27c06097-0f78-4684-9bb3-665b933e286f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:50.647880 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-27c06097-0f78-4684-9bb3-665b933e286f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:50.797771 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-27c06097-0f78-4684-9bb3-665b933e286f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:50.805846 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-27c06097-0f78-4684-9bb3-665b933e286f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:50.807999 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-27c06097-0f78-4684-9bb3-665b933e286f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:50.809081 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-27c06097-0f78-4684-9bb3-665b933e286f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1729 microversion: 2.20 time: 0.174333 Nov 15 12:46:50.809643 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 477/982] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:50 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 15 12:46:51.422174 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-fb636521-5bf3-45dc-8500-65ec12dad287 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:51.422836 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-fb636521-5bf3-45dc-8500-65ec12dad287 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: fb106071-4d21-44c8-b21d-653a55a214ca] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:51.429203 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-fb636521-5bf3-45dc-8500-65ec12dad287 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:51.429725 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-fb636521-5bf3-45dc-8500-65ec12dad287 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:51.430503 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-fb636521-5bf3-45dc-8500-65ec12dad287 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:51.430962 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-fb636521-5bf3-45dc-8500-65ec12dad287 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:51.500388 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-fb636521-5bf3-45dc-8500-65ec12dad287 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:51.508052 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-fb636521-5bf3-45dc-8500-65ec12dad287 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca" status: 200 len: 1270 microversion: 2.1 time: 0.090421 Nov 15 12:46:51.508644 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 506/983] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:46:51 2021] GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:46:51.830695 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-9bdf3407-f9a5-4fd7-a902-29e6d4788f21 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:51.830695 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-9bdf3407-f9a5-4fd7-a902-29e6d4788f21 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:51.836761 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9bdf3407-f9a5-4fd7-a902-29e6d4788f21 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:51.837206 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9bdf3407-f9a5-4fd7-a902-29e6d4788f21 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:51.837997 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9bdf3407-f9a5-4fd7-a902-29e6d4788f21 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:51.839183 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9bdf3407-f9a5-4fd7-a902-29e6d4788f21 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:52.002033 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-9bdf3407-f9a5-4fd7-a902-29e6d4788f21 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:52.012099 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-9bdf3407-f9a5-4fd7-a902-29e6d4788f21 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:52.013506 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-9bdf3407-f9a5-4fd7-a902-29e6d4788f21 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:52.014847 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-9bdf3407-f9a5-4fd7-a902-29e6d4788f21 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1729 microversion: 2.20 time: 0.189425 Nov 15 12:46:52.015399 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 478/984] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:51 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1729 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:52.528854 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-85570726-20c0-439c-ba6c-572b5341c8d2 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:52.529459 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-85570726-20c0-439c-ba6c-572b5341c8d2 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: fb106071-4d21-44c8-b21d-653a55a214ca] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:52.535812 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-85570726-20c0-439c-ba6c-572b5341c8d2 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:52.536256 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-85570726-20c0-439c-ba6c-572b5341c8d2 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:52.537021 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-85570726-20c0-439c-ba6c-572b5341c8d2 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:52.537448 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-85570726-20c0-439c-ba6c-572b5341c8d2 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:52.598695 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-85570726-20c0-439c-ba6c-572b5341c8d2 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:52.606960 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-85570726-20c0-439c-ba6c-572b5341c8d2 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca" status: 200 len: 1270 microversion: 2.1 time: 0.081824 Nov 15 12:46:52.607538 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 507/985] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:46:52 2021] GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca => generated 1270 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:46:53.032984 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-0e841b8d-e6a7-4272-aff0-8c18bc7e3a7f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:53.033603 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-0e841b8d-e6a7-4272-aff0-8c18bc7e3a7f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:53.039924 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0e841b8d-e6a7-4272-aff0-8c18bc7e3a7f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:53.040372 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0e841b8d-e6a7-4272-aff0-8c18bc7e3a7f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:53.041142 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0e841b8d-e6a7-4272-aff0-8c18bc7e3a7f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:53.042363 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0e841b8d-e6a7-4272-aff0-8c18bc7e3a7f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:53.174801 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-0e841b8d-e6a7-4272-aff0-8c18bc7e3a7f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:53.183949 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-0e841b8d-e6a7-4272-aff0-8c18bc7e3a7f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:53.185447 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-0e841b8d-e6a7-4272-aff0-8c18bc7e3a7f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:53.186616 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-0e841b8d-e6a7-4272-aff0-8c18bc7e3a7f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1729 microversion: 2.20 time: 0.157412 Nov 15 12:46:53.187226 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 479/986] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:53 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:53.624657 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-3f653dc9-6349-4ed7-ad39-14937c8d78cf tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:53.625304 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-3f653dc9-6349-4ed7-ad39-14937c8d78cf tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: fb106071-4d21-44c8-b21d-653a55a214ca] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:53.631392 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3f653dc9-6349-4ed7-ad39-14937c8d78cf tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:53.631834 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3f653dc9-6349-4ed7-ad39-14937c8d78cf tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:53.632608 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3f653dc9-6349-4ed7-ad39-14937c8d78cf tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:53.633038 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3f653dc9-6349-4ed7-ad39-14937c8d78cf tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:53.707339 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-3f653dc9-6349-4ed7-ad39-14937c8d78cf tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:53.714521 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-3f653dc9-6349-4ed7-ad39-14937c8d78cf tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca" status: 200 len: 1276 microversion: 2.1 time: 0.093976 Nov 15 12:46:53.715123 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 508/987] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:46:53 2021] GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca => generated 1276 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:46:54.204920 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-abe78e6a-bc41-4aaa-9445-869e54271518 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:54.205583 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-abe78e6a-bc41-4aaa-9445-869e54271518 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:54.211962 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-abe78e6a-bc41-4aaa-9445-869e54271518 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:54.212432 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-abe78e6a-bc41-4aaa-9445-869e54271518 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:54.213631 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-abe78e6a-bc41-4aaa-9445-869e54271518 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:54.214367 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-abe78e6a-bc41-4aaa-9445-869e54271518 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:54.440204 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-abe78e6a-bc41-4aaa-9445-869e54271518 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:54.449103 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-abe78e6a-bc41-4aaa-9445-869e54271518 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:54.450584 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-abe78e6a-bc41-4aaa-9445-869e54271518 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:54.451758 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-abe78e6a-bc41-4aaa-9445-869e54271518 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1729 microversion: 2.20 time: 0.250829 Nov 15 12:46:54.452320 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 480/988] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:54 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1729 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:54.733397 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-9c4c88b3-58d4-4204-a164-fed77503f0b9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:54.734006 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-9c4c88b3-58d4-4204-a164-fed77503f0b9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: fb106071-4d21-44c8-b21d-653a55a214ca] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:54.741378 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9c4c88b3-58d4-4204-a164-fed77503f0b9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:54.741920 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9c4c88b3-58d4-4204-a164-fed77503f0b9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:54.742746 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9c4c88b3-58d4-4204-a164-fed77503f0b9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:54.743223 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9c4c88b3-58d4-4204-a164-fed77503f0b9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:54.744227 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-47153552-1da5-4f36-a04a-4bd4c1f28447 req-e97390d5-bdc0-46b9-9a42-2a61a0f2fa64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb106071-4d21-44c8-b21d-653a55a214ca", "tag": "cdda0c80-f41d-4d26-b88b-3cf602da9cca"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:46:54.746967 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:46:54.746967 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:46:54.754928 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-47153552-1da5-4f36-a04a-4bd4c1f28447 req-e97390d5-bdc0-46b9-9a42-2a61a0f2fa64 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:54.755744 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-47153552-1da5-4f36-a04a-4bd4c1f28447 req-e97390d5-bdc0-46b9-9a42-2a61a0f2fa64 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:54.768298 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-47153552-1da5-4f36-a04a-4bd4c1f28447 req-e97390d5-bdc0-46b9-9a42-2a61a0f2fa64 service nova] Creating event network-changed:cdda0c80-f41d-4d26-b88b-3cf602da9cca for instance fb106071-4d21-44c8-b21d-653a55a214ca on hv-cinder-68088 Nov 15 12:46:54.773572 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-47153552-1da5-4f36-a04a-4bd4c1f28447 req-e97390d5-bdc0-46b9-9a42-2a61a0f2fa64 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033774 Nov 15 12:46:54.774250 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 481/989] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:46:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:46:54.975008 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-9c4c88b3-58d4-4204-a164-fed77503f0b9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:54.982993 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-9c4c88b3-58d4-4204-a164-fed77503f0b9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca" status: 200 len: 1318 microversion: 2.1 time: 0.254308 Nov 15 12:46:54.983505 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 509/990] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:46:54 2021] GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:46:55.471618 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-7896502d-49a1-4b9e-89a7-45f7a83f4cb5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:55.472745 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-7896502d-49a1-4b9e-89a7-45f7a83f4cb5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:55.479729 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7896502d-49a1-4b9e-89a7-45f7a83f4cb5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:55.480188 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7896502d-49a1-4b9e-89a7-45f7a83f4cb5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:55.480981 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7896502d-49a1-4b9e-89a7-45f7a83f4cb5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:55.481414 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7896502d-49a1-4b9e-89a7-45f7a83f4cb5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:55.732906 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-7896502d-49a1-4b9e-89a7-45f7a83f4cb5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:55.741212 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-7896502d-49a1-4b9e-89a7-45f7a83f4cb5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:55.742967 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-7896502d-49a1-4b9e-89a7-45f7a83f4cb5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:55.744120 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-7896502d-49a1-4b9e-89a7-45f7a83f4cb5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1729 microversion: 2.20 time: 0.277287 Nov 15 12:46:55.754856 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 482/991] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:55 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1729 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:55.999974 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-965b26e2-a369-4067-bb92-9583cf7245a1 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:56.000580 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-965b26e2-a369-4067-bb92-9583cf7245a1 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: fb106071-4d21-44c8-b21d-653a55a214ca] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:56.006924 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-965b26e2-a369-4067-bb92-9583cf7245a1 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:56.007367 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-965b26e2-a369-4067-bb92-9583cf7245a1 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:56.008136 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-965b26e2-a369-4067-bb92-9583cf7245a1 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:56.008562 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-965b26e2-a369-4067-bb92-9583cf7245a1 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:56.146071 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-965b26e2-a369-4067-bb92-9583cf7245a1 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:56.153638 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-965b26e2-a369-4067-bb92-9583cf7245a1 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca" status: 200 len: 1318 microversion: 2.1 time: 0.157264 Nov 15 12:46:56.154243 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 510/992] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:46:55 2021] GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:46:56.762341 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-ad26204f-821e-41e2-a31a-827651c9487d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:56.762974 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-ad26204f-821e-41e2-a31a-827651c9487d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:56.769332 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ad26204f-821e-41e2-a31a-827651c9487d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:56.769775 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ad26204f-821e-41e2-a31a-827651c9487d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:56.770553 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ad26204f-821e-41e2-a31a-827651c9487d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:56.771016 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ad26204f-821e-41e2-a31a-827651c9487d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:56.903397 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-ad26204f-821e-41e2-a31a-827651c9487d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:56.911055 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-ad26204f-821e-41e2-a31a-827651c9487d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:56.912531 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-ad26204f-821e-41e2-a31a-827651c9487d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:56.913666 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-ad26204f-821e-41e2-a31a-827651c9487d tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1729 microversion: 2.20 time: 0.155494 Nov 15 12:46:56.914210 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 483/993] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:56 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:57.171322 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-dcb7a1f8-f8fb-40e1-9ae9-fcd3f881c68d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:57.171933 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-dcb7a1f8-f8fb-40e1-9ae9-fcd3f881c68d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: fb106071-4d21-44c8-b21d-653a55a214ca] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:57.178224 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-dcb7a1f8-f8fb-40e1-9ae9-fcd3f881c68d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:57.178672 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-dcb7a1f8-f8fb-40e1-9ae9-fcd3f881c68d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:57.179514 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-dcb7a1f8-f8fb-40e1-9ae9-fcd3f881c68d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:57.179948 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-dcb7a1f8-f8fb-40e1-9ae9-fcd3f881c68d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:57.318425 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-dcb7a1f8-f8fb-40e1-9ae9-fcd3f881c68d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:57.326635 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-dcb7a1f8-f8fb-40e1-9ae9-fcd3f881c68d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca" status: 200 len: 1318 microversion: 2.1 time: 0.159286 Nov 15 12:46:57.327234 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 511/994] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:46:57 2021] GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:46:57.932863 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-f82f9565-2330-416f-a06d-250369aec3ba tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:57.933461 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-f82f9565-2330-416f-a06d-250369aec3ba tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:57.940056 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f82f9565-2330-416f-a06d-250369aec3ba tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:57.940650 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f82f9565-2330-416f-a06d-250369aec3ba tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:57.941472 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f82f9565-2330-416f-a06d-250369aec3ba tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:57.941899 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f82f9565-2330-416f-a06d-250369aec3ba tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:58.076134 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-f82f9565-2330-416f-a06d-250369aec3ba tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:58.083926 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-f82f9565-2330-416f-a06d-250369aec3ba tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:58.085418 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-f82f9565-2330-416f-a06d-250369aec3ba tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:58.086575 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-f82f9565-2330-416f-a06d-250369aec3ba tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1729 microversion: 2.20 time: 0.158096 Nov 15 12:46:58.087161 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 484/995] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:57 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:58.171672 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [req-3253a0fe-37bb-4d05-8dc3-891ffde740b5 req-90c1dafb-d021-4f60-8b40-1e27b1d6e94b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12e0ab18-a841-4228-bebb-1c5d1db6f7f6", "name": "network-vif-plugged", "status": "completed", "tag": "ffefc1bf-d747-45f6-8979-9a984c11ed67"}]} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:46:58.173227 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:46:58.173227 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: warnings.warn(msg) Nov 15 12:46:58.180904 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-3253a0fe-37bb-4d05-8dc3-891ffde740b5 req-90c1dafb-d021-4f60-8b40-1e27b1d6e94b service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:58.181354 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-3253a0fe-37bb-4d05-8dc3-891ffde740b5 req-90c1dafb-d021-4f60-8b40-1e27b1d6e94b service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:58.192995 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.compute.server_external_events [req-3253a0fe-37bb-4d05-8dc3-891ffde740b5 req-90c1dafb-d021-4f60-8b40-1e27b1d6e94b service nova] Creating event network-vif-plugged:ffefc1bf-d747-45f6-8979-9a984c11ed67 for instance 12e0ab18-a841-4228-bebb-1c5d1db6f7f6 on hv-cinder-68088 Nov 15 12:46:58.198877 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [req-3253a0fe-37bb-4d05-8dc3-891ffde740b5 req-90c1dafb-d021-4f60-8b40-1e27b1d6e94b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032079 Nov 15 12:46:58.199884 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 512/996] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:46:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:46:58.343870 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-584e7f3a-e17f-45b1-a770-97800510704e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:58.344467 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-584e7f3a-e17f-45b1-a770-97800510704e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: fb106071-4d21-44c8-b21d-653a55a214ca] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:58.350590 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-584e7f3a-e17f-45b1-a770-97800510704e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:58.351064 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-584e7f3a-e17f-45b1-a770-97800510704e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:58.351920 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-584e7f3a-e17f-45b1-a770-97800510704e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:58.352346 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-584e7f3a-e17f-45b1-a770-97800510704e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:58.784100 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-584e7f3a-e17f-45b1-a770-97800510704e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:58.791529 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-584e7f3a-e17f-45b1-a770-97800510704e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca" status: 200 len: 1318 microversion: 2.1 time: 0.451316 Nov 15 12:46:58.792264 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 485/997] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:46:58 2021] GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca => generated 1318 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:46:59.106114 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-216b662b-19fd-439b-9017-0a2a127ff92f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:59.106721 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-216b662b-19fd-439b-9017-0a2a127ff92f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:59.112814 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-216b662b-19fd-439b-9017-0a2a127ff92f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:59.113259 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-216b662b-19fd-439b-9017-0a2a127ff92f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:59.114031 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-216b662b-19fd-439b-9017-0a2a127ff92f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:59.114463 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-216b662b-19fd-439b-9017-0a2a127ff92f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:59.254363 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-216b662b-19fd-439b-9017-0a2a127ff92f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:59.262447 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-216b662b-19fd-439b-9017-0a2a127ff92f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:59.263966 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-216b662b-19fd-439b-9017-0a2a127ff92f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:46:59.265204 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-216b662b-19fd-439b-9017-0a2a127ff92f tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1729 microversion: 2.20 time: 0.163519 Nov 15 12:46:59.265832 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 513/998] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:46:59 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:46:59.813860 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-5449c140-c815-4c65-afa9-47db90c2b06e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:46:59.815079 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-5449c140-c815-4c65-afa9-47db90c2b06e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: fb106071-4d21-44c8-b21d-653a55a214ca] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:46:59.824761 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5449c140-c815-4c65-afa9-47db90c2b06e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:59.825295 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5449c140-c815-4c65-afa9-47db90c2b06e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:46:59.826085 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5449c140-c815-4c65-afa9-47db90c2b06e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:46:59.826517 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5449c140-c815-4c65-afa9-47db90c2b06e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:00.014077 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-5449c140-c815-4c65-afa9-47db90c2b06e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:00.022511 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-5449c140-c815-4c65-afa9-47db90c2b06e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca" status: 200 len: 1318 microversion: 2.1 time: 0.216240 Nov 15 12:47:00.023209 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 486/999] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:46:59 2021] GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:00.219620 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [req-404bcae8-5c84-4c06-9cb2-a3f6f4cb5f15 req-2bf8f368-57ae-4f6b-b788-66cec79d27c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb106071-4d21-44c8-b21d-653a55a214ca", "name": "network-vif-plugged", "status": "completed", "tag": "cdda0c80-f41d-4d26-b88b-3cf602da9cca"}]} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:47:00.221121 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:47:00.221121 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: warnings.warn(msg) Nov 15 12:47:00.228327 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-404bcae8-5c84-4c06-9cb2-a3f6f4cb5f15 req-2bf8f368-57ae-4f6b-b788-66cec79d27c3 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:00.228805 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-404bcae8-5c84-4c06-9cb2-a3f6f4cb5f15 req-2bf8f368-57ae-4f6b-b788-66cec79d27c3 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:00.284897 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-e69df4ea-819f-41e9-9d52-2a4039f725c4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:00.285516 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-e69df4ea-819f-41e9-9d52-2a4039f725c4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:00.292576 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e69df4ea-819f-41e9-9d52-2a4039f725c4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:00.293020 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e69df4ea-819f-41e9-9d52-2a4039f725c4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:00.293838 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e69df4ea-819f-41e9-9d52-2a4039f725c4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:00.294698 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e69df4ea-819f-41e9-9d52-2a4039f725c4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:00.392383 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.compute.server_external_events [req-404bcae8-5c84-4c06-9cb2-a3f6f4cb5f15 req-2bf8f368-57ae-4f6b-b788-66cec79d27c3 service nova] Creating event network-vif-plugged:cdda0c80-f41d-4d26-b88b-3cf602da9cca for instance fb106071-4d21-44c8-b21d-653a55a214ca on hv-cinder-68088 Nov 15 12:47:00.397185 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [req-404bcae8-5c84-4c06-9cb2-a3f6f4cb5f15 req-2bf8f368-57ae-4f6b-b788-66cec79d27c3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181093 Nov 15 12:47:00.397778 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 514/1000] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:47:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:47:00.436949 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-e69df4ea-819f-41e9-9d52-2a4039f725c4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:00.444833 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-e69df4ea-819f-41e9-9d52-2a4039f725c4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:00.446330 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-e69df4ea-819f-41e9-9d52-2a4039f725c4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:00.447592 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-e69df4ea-819f-41e9-9d52-2a4039f725c4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1729 microversion: 2.20 time: 0.167339 Nov 15 12:47:00.448172 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 487/1001] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:47:00 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 15 12:47:01.040668 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-35d98228-196f-4065-891f-098fbf1cc308 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:01.041360 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-35d98228-196f-4065-891f-098fbf1cc308 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: fb106071-4d21-44c8-b21d-653a55a214ca] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:01.047733 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-35d98228-196f-4065-891f-098fbf1cc308 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:01.048173 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-35d98228-196f-4065-891f-098fbf1cc308 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:01.048931 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-35d98228-196f-4065-891f-098fbf1cc308 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:01.049355 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-35d98228-196f-4065-891f-098fbf1cc308 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:01.180425 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-35d98228-196f-4065-891f-098fbf1cc308 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:01.188535 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-35d98228-196f-4065-891f-098fbf1cc308 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca" status: 200 len: 1318 microversion: 2.1 time: 0.151873 Nov 15 12:47:01.189095 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 515/1002] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:01 2021] GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:01.465277 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-61444ea3-5119-4225-8303-258a891daab5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:01.465932 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-61444ea3-5119-4225-8303-258a891daab5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:01.472222 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-61444ea3-5119-4225-8303-258a891daab5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:01.472665 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-61444ea3-5119-4225-8303-258a891daab5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:01.473441 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-61444ea3-5119-4225-8303-258a891daab5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:01.473867 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-61444ea3-5119-4225-8303-258a891daab5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:01.605156 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-61444ea3-5119-4225-8303-258a891daab5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:01.612987 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-61444ea3-5119-4225-8303-258a891daab5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:01.614491 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-61444ea3-5119-4225-8303-258a891daab5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:01.615673 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-61444ea3-5119-4225-8303-258a891daab5 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1716 microversion: 2.20 time: 0.154216 Nov 15 12:47:01.616290 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 488/1003] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:47:01 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:47:02.205043 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-147d3c4a-26ac-414c-a317-813207e5e707 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:02.205644 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-147d3c4a-26ac-414c-a317-813207e5e707 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: fb106071-4d21-44c8-b21d-653a55a214ca] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:02.212189 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-147d3c4a-26ac-414c-a317-813207e5e707 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:02.212632 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-147d3c4a-26ac-414c-a317-813207e5e707 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:02.213512 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-147d3c4a-26ac-414c-a317-813207e5e707 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:02.213935 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-147d3c4a-26ac-414c-a317-813207e5e707 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:02.348205 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-147d3c4a-26ac-414c-a317-813207e5e707 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:02.356815 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-147d3c4a-26ac-414c-a317-813207e5e707 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca" status: 200 len: 1508 microversion: 2.1 time: 0.155360 Nov 15 12:47:02.357743 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 516/1004] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:02 2021] GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:03.102094 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-f4d380f8-bdf1-4d67-9694-a4cd45a96949 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:03.102618 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-f4d380f8-bdf1-4d67-9694-a4cd45a96949 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:03.107743 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [req-96e90ebb-1463-4334-a5c4-f2f1e16439f4 req-6dacf6db-ca65-4f69-b9b5-65d11d355976 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a56962f0-d8f9-4778-a21e-1f2bc81789fe", "tag": "5e3438d8-9d94-405a-af06-a2bd0727491d"}]} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:47:03.109237 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:47:03.109237 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: warnings.warn(msg) Nov 15 12:47:03.115870 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f4d380f8-bdf1-4d67-9694-a4cd45a96949 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:03.116158 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-96e90ebb-1463-4334-a5c4-f2f1e16439f4 req-6dacf6db-ca65-4f69-b9b5-65d11d355976 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:03.116527 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f4d380f8-bdf1-4d67-9694-a4cd45a96949 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:03.116665 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-96e90ebb-1463-4334-a5c4-f2f1e16439f4 req-6dacf6db-ca65-4f69-b9b5-65d11d355976 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:03.117485 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f4d380f8-bdf1-4d67-9694-a4cd45a96949 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:03.118013 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f4d380f8-bdf1-4d67-9694-a4cd45a96949 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:03.127689 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.compute.server_external_events [req-96e90ebb-1463-4334-a5c4-f2f1e16439f4 req-6dacf6db-ca65-4f69-b9b5-65d11d355976 service nova] Creating event network-changed:5e3438d8-9d94-405a-af06-a2bd0727491d for instance a56962f0-d8f9-4778-a21e-1f2bc81789fe on hv-cinder-68088 Nov 15 12:47:03.132557 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [req-96e90ebb-1463-4334-a5c4-f2f1e16439f4 req-6dacf6db-ca65-4f69-b9b5-65d11d355976 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028390 Nov 15 12:47:03.133342 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 517/1005] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:47:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:47:03.146216 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-f4d380f8-bdf1-4d67-9694-a4cd45a96949 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Going to try to terminate instance {{(pid=122568) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 15 12:47:03.242495 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-f4d380f8-bdf1-4d67-9694-a4cd45a96949 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 204 len: 0 microversion: 2.1 time: 0.143641 Nov 15 12:47:03.243969 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 489/1006] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Nov 15 12:47:03 2021] DELETE /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 15 12:47:03.254187 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-802ad37e-4416-42de-a327-1a459e87c06f tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:03.255027 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-802ad37e-4416-42de-a327-1a459e87c06f tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:03.262298 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-802ad37e-4416-42de-a327-1a459e87c06f tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:03.262914 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-802ad37e-4416-42de-a327-1a459e87c06f tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:03.263789 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-802ad37e-4416-42de-a327-1a459e87c06f tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:03.264299 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-802ad37e-4416-42de-a327-1a459e87c06f tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:03.525173 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-802ad37e-4416-42de-a327-1a459e87c06f tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:03.532974 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-802ad37e-4416-42de-a327-1a459e87c06f tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1570 microversion: 2.1 time: 0.283289 Nov 15 12:47:03.534240 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 518/1007] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:03 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1570 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:03.722473 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-62ff8f45-eee5-4451-ab2d-e59cd7b8eb23 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62d668fc-1c26-49b5-a467-f5d84928883b"}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:47:03.723946 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-62ff8f45-eee5-4451-ab2d-e59cd7b8eb23 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: fb106071-4d21-44c8-b21d-653a55a214ca] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:03.730547 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-62ff8f45-eee5-4451-ab2d-e59cd7b8eb23 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:03.732082 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-62ff8f45-eee5-4451-ab2d-e59cd7b8eb23 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:03.733057 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-62ff8f45-eee5-4451-ab2d-e59cd7b8eb23 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:03.733645 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-62ff8f45-eee5-4451-ab2d-e59cd7b8eb23 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:03.999520 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-62ff8f45-eee5-4451-ab2d-e59cd7b8eb23 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "POST /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281883 Nov 15 12:47:04.000133 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 490/1008] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Nov 15 12:47:03 2021] POST /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:47:04.550625 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-2961ff43-7198-4a55-bf5f-8ff9ae746140 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:04.551221 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-2961ff43-7198-4a55-bf5f-8ff9ae746140 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:04.557445 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2961ff43-7198-4a55-bf5f-8ff9ae746140 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:04.558584 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2961ff43-7198-4a55-bf5f-8ff9ae746140 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:04.559418 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2961ff43-7198-4a55-bf5f-8ff9ae746140 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:04.559936 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2961ff43-7198-4a55-bf5f-8ff9ae746140 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:04.653827 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 15 12:47:04.654138 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: Mon Nov 15 12:47:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe (ip 10.222.0.43) !!! Nov 15 12:47:04.705564 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-2961ff43-7198-4a55-bf5f-8ff9ae746140 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:04.713551 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-2961ff43-7198-4a55-bf5f-8ff9ae746140 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1451 microversion: 2.1 time: 0.166622 Nov 15 12:47:04.714202 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 519/1009] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:04 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1451 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:05.684332 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-49f801e7-bd90-434c-86a3-dfa665748f35 req-e5630573-f3c8-4f91-99e6-6e0f2abefdad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a56962f0-d8f9-4778-a21e-1f2bc81789fe", "name": "network-vif-deleted", "tag": "5e3438d8-9d94-405a-af06-a2bd0727491d"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:47:05.686150 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:47:05.686150 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:47:05.694390 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-49f801e7-bd90-434c-86a3-dfa665748f35 req-e5630573-f3c8-4f91-99e6-6e0f2abefdad service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:05.694856 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-49f801e7-bd90-434c-86a3-dfa665748f35 req-e5630573-f3c8-4f91-99e6-6e0f2abefdad service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:05.708660 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-49f801e7-bd90-434c-86a3-dfa665748f35 req-e5630573-f3c8-4f91-99e6-6e0f2abefdad service nova] Creating event network-vif-deleted:5e3438d8-9d94-405a-af06-a2bd0727491d for instance a56962f0-d8f9-4778-a21e-1f2bc81789fe on hv-cinder-68088 Nov 15 12:47:05.713922 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-49f801e7-bd90-434c-86a3-dfa665748f35 req-e5630573-f3c8-4f91-99e6-6e0f2abefdad service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035116 Nov 15 12:47:05.714526 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 491/1010] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:47:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 15 12:47:05.731812 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-ae0a0b3c-0ee0-4e55-9a68-da498d036b58 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:05.732426 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-ae0a0b3c-0ee0-4e55-9a68-da498d036b58 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:05.738646 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ae0a0b3c-0ee0-4e55-9a68-da498d036b58 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:05.739131 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ae0a0b3c-0ee0-4e55-9a68-da498d036b58 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:05.739914 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ae0a0b3c-0ee0-4e55-9a68-da498d036b58 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:05.740351 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ae0a0b3c-0ee0-4e55-9a68-da498d036b58 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:05.803827 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-ae0a0b3c-0ee0-4e55-9a68-da498d036b58 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0fb21696184f6ea168fa860bf7d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7191bcfe4454fd9b47db87e8aa6e497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:05.812525 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-ae0a0b3c-0ee0-4e55-9a68-da498d036b58 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 200 len: 1220 microversion: 2.1 time: 0.084351 Nov 15 12:47:05.813099 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 520/1011] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:05 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:06.829514 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-a483e4c5-beb9-4970-954a-fab825a124b6 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:06.830112 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-a483e4c5-beb9-4970-954a-fab825a124b6 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] [instance: a56962f0-d8f9-4778-a21e-1f2bc81789fe] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:06.836250 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a483e4c5-beb9-4970-954a-fab825a124b6 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:06.836695 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a483e4c5-beb9-4970-954a-fab825a124b6 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:06.837463 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a483e4c5-beb9-4970-954a-fab825a124b6 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:06.837891 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a483e4c5-beb9-4970-954a-fab825a124b6 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:06.851112 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.wsgi [None req-a483e4c5-beb9-4970-954a-fab825a124b6 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] HTTP exception thrown: Instance a56962f0-d8f9-4778-a21e-1f2bc81789fe could not be found. Nov 15 12:47:06.851691 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-a483e4c5-beb9-4970-954a-fab825a124b6 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Returning 404 to user: Instance a56962f0-d8f9-4778-a21e-1f2bc81789fe could not be found. {{(pid=122568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:47:06.852532 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-a483e4c5-beb9-4970-954a-fab825a124b6 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe" status: 404 len: 111 microversion: 2.1 time: 0.027593 Nov 15 12:47:06.853063 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 492/1012] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:06 2021] GET /compute/v2.1/servers/a56962f0-d8f9-4778-a21e-1f2bc81789fe => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 15 12:47:07.019647 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-0601c628-595f-407b-94f0-2a40d934e100 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] Calling method '.version_select at 0x7f132027fa60>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:07.044774 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-0601c628-595f-407b-94f0-2a40d934e100 tempest-TestShelveInstance-1194841206 tempest-TestShelveInstance-1194841206-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1893789649" status: 202 len: 0 microversion: 2.1 time: 0.028251 Nov 15 12:47:07.047010 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 521/1013] 10.222.0.43 () {58 vars in 1253 bytes} [Mon Nov 15 12:47:07 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1893789649 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 15 12:47:11.574576 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-c5e354d0-0037-4581-8fc4-6cba2e1d013a tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1049164247", "imageRef": "3cc21e2c-27da-4266-be76-369023341c16", "flavorRef": "452", "networks": [{"uuid": "b5e792a7-3bc7-401c-8890-d6bf3bed54f7"}]}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:47:11.642344 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.network.neutron [None req-c5e354d0-0037-4581-8fc4-6cba2e1d013a tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] validate_networks() for [('b5e792a7-3bc7-401c-8890-d6bf3bed54f7', None, None, None, None, None)] {{(pid=122568) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 15 12:47:12.021973 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-c5e354d0-0037-4581-8fc4-6cba2e1d013a tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Flavor limits 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 15 12:47:12.022375 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-c5e354d0-0037-4581-8fc4-6cba2e1d013a tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Image limits 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 15 12:47:12.022863 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-c5e354d0-0037-4581-8fc4-6cba2e1d013a tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Flavor pref 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 15 12:47:12.023255 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-c5e354d0-0037-4581-8fc4-6cba2e1d013a tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Image pref 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 15 12:47:12.023651 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-c5e354d0-0037-4581-8fc4-6cba2e1d013a tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 15 12:47:12.032872 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c5e354d0-0037-4581-8fc4-6cba2e1d013a tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:12.033305 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c5e354d0-0037-4581-8fc4-6cba2e1d013a tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:12.034127 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c5e354d0-0037-4581-8fc4-6cba2e1d013a tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:12.034554 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c5e354d0-0037-4581-8fc4-6cba2e1d013a tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:12.051028 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-c5e354d0-0037-4581-8fc4-6cba2e1d013a tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Getting quotas for project 8b023f637e184e67bccf0ed11a6a802d. Resources: {'cores', 'ram', 'instances'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:47:12.055035 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-c5e354d0-0037-4581-8fc4-6cba2e1d013a tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Getting quotas for user ca6612e1905c4e70b39aaa552b9de730 and project 8b023f637e184e67bccf0ed11a6a802d. Resources: {'cores', 'ram', 'instances'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:47:12.065558 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-c5e354d0-0037-4581-8fc4-6cba2e1d013a tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Going to run 1 instances... {{(pid=122568) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 15 12:47:12.067926 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-c5e354d0-0037-4581-8fc4-6cba2e1d013a tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: bca45233-33d6-4c53-a043-8c482833c962] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3cc21e2c-27da-4266-be76-369023341c16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 15 12:47:12.113011 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-c5e354d0-0037-4581-8fc4-6cba2e1d013a tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546039 Nov 15 12:47:12.113916 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 493/1014] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Nov 15 12:47:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 15 12:47:12.124615 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e6ef62ab-60b2-444b-bfcd-f6474be00ff5 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:12.125907 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e6ef62ab-60b2-444b-bfcd-f6474be00ff5 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: bca45233-33d6-4c53-a043-8c482833c962] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:12.211467 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e6ef62ab-60b2-444b-bfcd-f6474be00ff5 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:12.220273 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e6ef62ab-60b2-444b-bfcd-f6474be00ff5 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/bca45233-33d6-4c53-a043-8c482833c962" status: 200 len: 1218 microversion: 2.1 time: 0.100054 Nov 15 12:47:12.220865 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 522/1015] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:12 2021] GET /compute/v2.1/servers/bca45233-33d6-4c53-a043-8c482833c962 => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:13.238071 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-5c79b718-5114-4d6f-8bdf-210cba63e91d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:13.238641 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-5c79b718-5114-4d6f-8bdf-210cba63e91d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: bca45233-33d6-4c53-a043-8c482833c962] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:13.254300 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5c79b718-5114-4d6f-8bdf-210cba63e91d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:13.254997 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5c79b718-5114-4d6f-8bdf-210cba63e91d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:13.255895 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5c79b718-5114-4d6f-8bdf-210cba63e91d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:13.256390 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5c79b718-5114-4d6f-8bdf-210cba63e91d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:13.389595 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-5c79b718-5114-4d6f-8bdf-210cba63e91d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:13.401192 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-5c79b718-5114-4d6f-8bdf-210cba63e91d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/bca45233-33d6-4c53-a043-8c482833c962" status: 200 len: 1278 microversion: 2.1 time: 0.167519 Nov 15 12:47:13.402956 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 494/1016] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:13 2021] GET /compute/v2.1/servers/bca45233-33d6-4c53-a043-8c482833c962 => generated 1278 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:14.420061 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-21b66b8b-24cc-41c3-a035-2e1c556d6f25 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:14.420896 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-21b66b8b-24cc-41c3-a035-2e1c556d6f25 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: bca45233-33d6-4c53-a043-8c482833c962] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:14.429247 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-21b66b8b-24cc-41c3-a035-2e1c556d6f25 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:14.429771 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-21b66b8b-24cc-41c3-a035-2e1c556d6f25 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:14.430659 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-21b66b8b-24cc-41c3-a035-2e1c556d6f25 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:14.431220 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-21b66b8b-24cc-41c3-a035-2e1c556d6f25 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:14.717493 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-21b66b8b-24cc-41c3-a035-2e1c556d6f25 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:14.725067 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-21b66b8b-24cc-41c3-a035-2e1c556d6f25 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/bca45233-33d6-4c53-a043-8c482833c962" status: 200 len: 1318 microversion: 2.1 time: 0.309628 Nov 15 12:47:14.726384 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 523/1017] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:14 2021] GET /compute/v2.1/servers/bca45233-33d6-4c53-a043-8c482833c962 => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:47:14.888760 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-5bb6823d-b630-43fd-a58a-2b9c096ea4c7 req-ed1a8826-f572-4854-8f95-2a9f6988e17c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bca45233-33d6-4c53-a043-8c482833c962", "tag": "e472414f-49b1-4318-a5a8-147ad466ee3d"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:47:14.891179 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:47:14.891179 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:47:14.903927 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-5bb6823d-b630-43fd-a58a-2b9c096ea4c7 req-ed1a8826-f572-4854-8f95-2a9f6988e17c service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:14.905432 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-5bb6823d-b630-43fd-a58a-2b9c096ea4c7 req-ed1a8826-f572-4854-8f95-2a9f6988e17c service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:14.935601 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-5bb6823d-b630-43fd-a58a-2b9c096ea4c7 req-ed1a8826-f572-4854-8f95-2a9f6988e17c service nova] Creating event network-changed:e472414f-49b1-4318-a5a8-147ad466ee3d for instance bca45233-33d6-4c53-a043-8c482833c962 on hv-cinder-68088 Nov 15 12:47:14.940639 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-5bb6823d-b630-43fd-a58a-2b9c096ea4c7 req-ed1a8826-f572-4854-8f95-2a9f6988e17c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055948 Nov 15 12:47:14.941366 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 495/1018] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:47:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:47:15.744077 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-994f366b-7a20-4065-8820-1f8dcfdf0ba0 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:15.744708 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-994f366b-7a20-4065-8820-1f8dcfdf0ba0 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: bca45233-33d6-4c53-a043-8c482833c962] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:15.751089 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-994f366b-7a20-4065-8820-1f8dcfdf0ba0 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:15.751727 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-994f366b-7a20-4065-8820-1f8dcfdf0ba0 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:15.752512 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-994f366b-7a20-4065-8820-1f8dcfdf0ba0 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:15.752942 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-994f366b-7a20-4065-8820-1f8dcfdf0ba0 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:15.994423 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-994f366b-7a20-4065-8820-1f8dcfdf0ba0 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:16.002180 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-994f366b-7a20-4065-8820-1f8dcfdf0ba0 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/bca45233-33d6-4c53-a043-8c482833c962" status: 200 len: 1318 microversion: 2.1 time: 0.261775 Nov 15 12:47:16.002989 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 524/1019] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:15 2021] GET /compute/v2.1/servers/bca45233-33d6-4c53-a043-8c482833c962 => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:17.021389 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-955eedad-6038-41db-895d-5c99d5bb5a29 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:17.022112 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-955eedad-6038-41db-895d-5c99d5bb5a29 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: bca45233-33d6-4c53-a043-8c482833c962] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:17.028895 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-955eedad-6038-41db-895d-5c99d5bb5a29 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:17.029336 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-955eedad-6038-41db-895d-5c99d5bb5a29 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:17.030106 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-955eedad-6038-41db-895d-5c99d5bb5a29 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:17.030537 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-955eedad-6038-41db-895d-5c99d5bb5a29 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:17.166661 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-955eedad-6038-41db-895d-5c99d5bb5a29 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:17.175069 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-955eedad-6038-41db-895d-5c99d5bb5a29 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/bca45233-33d6-4c53-a043-8c482833c962" status: 200 len: 1318 microversion: 2.1 time: 0.158123 Nov 15 12:47:17.175645 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 496/1020] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:17 2021] GET /compute/v2.1/servers/bca45233-33d6-4c53-a043-8c482833c962 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:18.192361 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-2d1ff20b-fdaa-4bb4-b9ef-55798f052269 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:18.192970 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-2d1ff20b-fdaa-4bb4-b9ef-55798f052269 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: bca45233-33d6-4c53-a043-8c482833c962] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:18.199389 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2d1ff20b-fdaa-4bb4-b9ef-55798f052269 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:18.199838 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2d1ff20b-fdaa-4bb4-b9ef-55798f052269 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:18.200630 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2d1ff20b-fdaa-4bb4-b9ef-55798f052269 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:18.201064 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2d1ff20b-fdaa-4bb4-b9ef-55798f052269 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:18.331767 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-2d1ff20b-fdaa-4bb4-b9ef-55798f052269 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:18.339562 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-2d1ff20b-fdaa-4bb4-b9ef-55798f052269 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/bca45233-33d6-4c53-a043-8c482833c962" status: 200 len: 1318 microversion: 2.1 time: 0.150404 Nov 15 12:47:18.340125 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 525/1021] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:18 2021] GET /compute/v2.1/servers/bca45233-33d6-4c53-a043-8c482833c962 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:19.356928 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-53f9df0a-5e4e-4f38-9cb6-9a6030c8fa7f tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:19.357529 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-53f9df0a-5e4e-4f38-9cb6-9a6030c8fa7f tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: bca45233-33d6-4c53-a043-8c482833c962] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:19.364253 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-53f9df0a-5e4e-4f38-9cb6-9a6030c8fa7f tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:19.364554 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-53f9df0a-5e4e-4f38-9cb6-9a6030c8fa7f tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:19.365347 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-53f9df0a-5e4e-4f38-9cb6-9a6030c8fa7f tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:19.365806 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-53f9df0a-5e4e-4f38-9cb6-9a6030c8fa7f tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:19.508482 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-53f9df0a-5e4e-4f38-9cb6-9a6030c8fa7f tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:19.515790 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-53f9df0a-5e4e-4f38-9cb6-9a6030c8fa7f tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/bca45233-33d6-4c53-a043-8c482833c962" status: 200 len: 1318 microversion: 2.1 time: 0.163163 Nov 15 12:47:19.516358 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 497/1022] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:19 2021] GET /compute/v2.1/servers/bca45233-33d6-4c53-a043-8c482833c962 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:47:20.017985 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [req-2f2a7f8c-f190-4843-9469-20a05294791e req-a178203a-dfb6-4a49-a19c-df37eb2730dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bca45233-33d6-4c53-a043-8c482833c962", "name": "network-vif-plugged", "status": "completed", "tag": "e472414f-49b1-4318-a5a8-147ad466ee3d"}]} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:47:20.019501 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:47:20.019501 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: warnings.warn(msg) Nov 15 12:47:20.027951 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-2f2a7f8c-f190-4843-9469-20a05294791e req-a178203a-dfb6-4a49-a19c-df37eb2730dd service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:20.028387 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-2f2a7f8c-f190-4843-9469-20a05294791e req-a178203a-dfb6-4a49-a19c-df37eb2730dd service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:20.039554 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.compute.server_external_events [req-2f2a7f8c-f190-4843-9469-20a05294791e req-a178203a-dfb6-4a49-a19c-df37eb2730dd service nova] Creating event network-vif-plugged:e472414f-49b1-4318-a5a8-147ad466ee3d for instance bca45233-33d6-4c53-a043-8c482833c962 on hv-cinder-68088 Nov 15 12:47:20.045466 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [req-2f2a7f8c-f190-4843-9469-20a05294791e req-a178203a-dfb6-4a49-a19c-df37eb2730dd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031127 Nov 15 12:47:20.046073 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 526/1023] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:47:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:47:20.532407 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-daad304c-4691-4b21-991b-5123faf4fcfa tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:20.532937 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-daad304c-4691-4b21-991b-5123faf4fcfa tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: bca45233-33d6-4c53-a043-8c482833c962] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:20.539250 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-daad304c-4691-4b21-991b-5123faf4fcfa tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:20.539695 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-daad304c-4691-4b21-991b-5123faf4fcfa tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:20.540471 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-daad304c-4691-4b21-991b-5123faf4fcfa tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:20.540902 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-daad304c-4691-4b21-991b-5123faf4fcfa tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:20.669595 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-daad304c-4691-4b21-991b-5123faf4fcfa tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:20.676796 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-daad304c-4691-4b21-991b-5123faf4fcfa tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/bca45233-33d6-4c53-a043-8c482833c962" status: 200 len: 1318 microversion: 2.1 time: 0.148164 Nov 15 12:47:20.677362 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 498/1024] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:20 2021] GET /compute/v2.1/servers/bca45233-33d6-4c53-a043-8c482833c962 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:21.695162 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-b94824d0-38b6-4519-9d23-fba99e7d0cef tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:21.695847 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-b94824d0-38b6-4519-9d23-fba99e7d0cef tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: bca45233-33d6-4c53-a043-8c482833c962] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:21.702416 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b94824d0-38b6-4519-9d23-fba99e7d0cef tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:21.702890 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b94824d0-38b6-4519-9d23-fba99e7d0cef tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:21.703657 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b94824d0-38b6-4519-9d23-fba99e7d0cef tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:21.704080 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b94824d0-38b6-4519-9d23-fba99e7d0cef tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:21.838384 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-b94824d0-38b6-4519-9d23-fba99e7d0cef tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:21.846857 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-b94824d0-38b6-4519-9d23-fba99e7d0cef tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/bca45233-33d6-4c53-a043-8c482833c962" status: 200 len: 1508 microversion: 2.1 time: 0.156259 Nov 15 12:47:21.847428 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 527/1025] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:21 2021] GET /compute/v2.1/servers/bca45233-33d6-4c53-a043-8c482833c962 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:21.866497 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-ee83c0ad-a788-4adc-ac3c-0d76cbc162d3 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62d668fc-1c26-49b5-a467-f5d84928883b"}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:47:21.867963 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-ee83c0ad-a788-4adc-ac3c-0d76cbc162d3 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: bca45233-33d6-4c53-a043-8c482833c962] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:21.877117 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ee83c0ad-a788-4adc-ac3c-0d76cbc162d3 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:21.877778 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ee83c0ad-a788-4adc-ac3c-0d76cbc162d3 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:21.878999 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ee83c0ad-a788-4adc-ac3c-0d76cbc162d3 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:21.879649 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ee83c0ad-a788-4adc-ac3c-0d76cbc162d3 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:21.960916 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.wsgi [None req-ee83c0ad-a788-4adc-ac3c-0d76cbc162d3 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] HTTP exception thrown: Invalid volume: volume 62d668fc-1c26-49b5-a467-f5d84928883b is already attached to instances: fb106071-4d21-44c8-b21d-653a55a214ca Nov 15 12:47:21.961497 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-ee83c0ad-a788-4adc-ac3c-0d76cbc162d3 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Returning 400 to user: Invalid volume: volume 62d668fc-1c26-49b5-a467-f5d84928883b is already attached to instances: fb106071-4d21-44c8-b21d-653a55a214ca {{(pid=122568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:47:21.962321 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-ee83c0ad-a788-4adc-ac3c-0d76cbc162d3 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "POST /compute/v2.1/servers/bca45233-33d6-4c53-a043-8c482833c962/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102086 Nov 15 12:47:21.962876 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 499/1026] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Nov 15 12:47:21 2021] POST /compute/v2.1/servers/bca45233-33d6-4c53-a043-8c482833c962/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 15 12:47:22.020157 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-8f377664-8c94-4013-99de-907069b15766 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:22.020641 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-8f377664-8c94-4013-99de-907069b15766 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: fb106071-4d21-44c8-b21d-653a55a214ca] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:22.026375 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8f377664-8c94-4013-99de-907069b15766 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:22.026907 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8f377664-8c94-4013-99de-907069b15766 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:22.027852 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8f377664-8c94-4013-99de-907069b15766 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:22.028276 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8f377664-8c94-4013-99de-907069b15766 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:22.106010 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.objects.instance [None req-8f377664-8c94-4013-99de-907069b15766 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lazy-loading 'services' on Instance uuid fb106071-4d21-44c8-b21d-653a55a214ca {{(pid=122567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 15 12:47:22.176967 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-8f377664-8c94-4013-99de-907069b15766 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca/os-volume_attachments/62d668fc-1c26-49b5-a467-f5d84928883b" status: 202 len: 0 microversion: 2.1 time: 0.160254 Nov 15 12:47:22.177752 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 528/1027] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Nov 15 12:47:22 2021] DELETE /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca/os-volume_attachments/62d668fc-1c26-49b5-a467-f5d84928883b => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:47:22.187393 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-66e86aa5-373e-42d1-86ea-054057e26a1a tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:22.188331 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-66e86aa5-373e-42d1-86ea-054057e26a1a tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: fb106071-4d21-44c8-b21d-653a55a214ca] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:22.200348 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-66e86aa5-373e-42d1-86ea-054057e26a1a tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:22.200348 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-66e86aa5-373e-42d1-86ea-054057e26a1a tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:22.200348 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-66e86aa5-373e-42d1-86ea-054057e26a1a tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:22.200348 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-66e86aa5-373e-42d1-86ea-054057e26a1a tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:22.230801 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-66e86aa5-373e-42d1-86ea-054057e26a1a tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047730 Nov 15 12:47:22.231532 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 500/1028] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Nov 15 12:47:22 2021] GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:47:23.243585 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-fad3b0b2-c572-4048-a56e-1687674769a5 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:23.244642 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-fad3b0b2-c572-4048-a56e-1687674769a5 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: fb106071-4d21-44c8-b21d-653a55a214ca] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:23.251162 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-fad3b0b2-c572-4048-a56e-1687674769a5 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:23.251608 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-fad3b0b2-c572-4048-a56e-1687674769a5 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:23.252371 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-fad3b0b2-c572-4048-a56e-1687674769a5 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:23.252794 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-fad3b0b2-c572-4048-a56e-1687674769a5 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:23.281901 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-fad3b0b2-c572-4048-a56e-1687674769a5 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042891 Nov 15 12:47:23.282447 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 529/1029] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Nov 15 12:47:23 2021] GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 15 12:47:23.444146 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-36214a30-ecf7-4d1d-8b34-9b94847d0a74 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-427228534", "imageRef": "3cc21e2c-27da-4266-be76-369023341c16", "flavorRef": "452", "networks": [{"uuid": "b5e792a7-3bc7-401c-8890-d6bf3bed54f7"}]}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:47:23.496262 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.network.neutron [None req-36214a30-ecf7-4d1d-8b34-9b94847d0a74 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] validate_networks() for [('b5e792a7-3bc7-401c-8890-d6bf3bed54f7', None, None, None, None, None)] {{(pid=122568) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 15 12:47:23.849496 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-36214a30-ecf7-4d1d-8b34-9b94847d0a74 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Flavor limits 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 15 12:47:23.850030 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-36214a30-ecf7-4d1d-8b34-9b94847d0a74 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Image limits 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 15 12:47:23.850491 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-36214a30-ecf7-4d1d-8b34-9b94847d0a74 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Flavor pref 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 15 12:47:23.850920 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-36214a30-ecf7-4d1d-8b34-9b94847d0a74 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Image pref 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 15 12:47:23.851324 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-36214a30-ecf7-4d1d-8b34-9b94847d0a74 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 15 12:47:23.863294 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-36214a30-ecf7-4d1d-8b34-9b94847d0a74 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:23.863819 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-36214a30-ecf7-4d1d-8b34-9b94847d0a74 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:23.865220 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-36214a30-ecf7-4d1d-8b34-9b94847d0a74 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:23.865660 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-36214a30-ecf7-4d1d-8b34-9b94847d0a74 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:23.882358 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-36214a30-ecf7-4d1d-8b34-9b94847d0a74 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Getting quotas for project 8b023f637e184e67bccf0ed11a6a802d. Resources: {'cores', 'ram', 'instances'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:47:23.886873 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-36214a30-ecf7-4d1d-8b34-9b94847d0a74 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Getting quotas for user ca6612e1905c4e70b39aaa552b9de730 and project 8b023f637e184e67bccf0ed11a6a802d. Resources: {'cores', 'ram', 'instances'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:47:23.900433 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-36214a30-ecf7-4d1d-8b34-9b94847d0a74 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Going to run 1 instances... {{(pid=122568) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 15 12:47:23.903764 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-36214a30-ecf7-4d1d-8b34-9b94847d0a74 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 7abe3987-72d1-4833-86a4-001443048c51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3cc21e2c-27da-4266-be76-369023341c16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 15 12:47:23.947276 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-36214a30-ecf7-4d1d-8b34-9b94847d0a74 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.506732 Nov 15 12:47:23.947929 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 501/1030] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Nov 15 12:47:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 15 12:47:23.958287 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-cbfe88f1-46de-42de-ab91-6a2d6e525c50 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:23.958928 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-cbfe88f1-46de-42de-ab91-6a2d6e525c50 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 7abe3987-72d1-4833-86a4-001443048c51] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:24.012278 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-cbfe88f1-46de-42de-ab91-6a2d6e525c50 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:24.018895 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-cbfe88f1-46de-42de-ab91-6a2d6e525c50 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51" status: 200 len: 1217 microversion: 2.1 time: 0.064243 Nov 15 12:47:24.019459 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 530/1031] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:23 2021] GET /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51 => generated 1217 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:25.037294 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-8ac4576b-3821-48ef-851e-b7efac9c8e45 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:25.039495 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-8ac4576b-3821-48ef-851e-b7efac9c8e45 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 7abe3987-72d1-4833-86a4-001443048c51] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:25.046899 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8ac4576b-3821-48ef-851e-b7efac9c8e45 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:25.047593 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8ac4576b-3821-48ef-851e-b7efac9c8e45 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:25.048590 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8ac4576b-3821-48ef-851e-b7efac9c8e45 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:25.049025 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8ac4576b-3821-48ef-851e-b7efac9c8e45 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:25.137088 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-8ac4576b-3821-48ef-851e-b7efac9c8e45 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:25.144884 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-8ac4576b-3821-48ef-851e-b7efac9c8e45 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51" status: 200 len: 1277 microversion: 2.1 time: 0.111659 Nov 15 12:47:25.145951 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 502/1032] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:25 2021] GET /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51 => generated 1277 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:26.161171 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-7260bda9-4253-4302-9435-2f2fb00c4828 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:26.161776 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-7260bda9-4253-4302-9435-2f2fb00c4828 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 7abe3987-72d1-4833-86a4-001443048c51] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:26.168504 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7260bda9-4253-4302-9435-2f2fb00c4828 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:26.168946 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7260bda9-4253-4302-9435-2f2fb00c4828 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:26.169988 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7260bda9-4253-4302-9435-2f2fb00c4828 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:26.170407 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7260bda9-4253-4302-9435-2f2fb00c4828 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:26.370160 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-7260bda9-4253-4302-9435-2f2fb00c4828 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:26.387980 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-7260bda9-4253-4302-9435-2f2fb00c4828 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51" status: 200 len: 1317 microversion: 2.1 time: 0.226717 Nov 15 12:47:26.388780 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 531/1033] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:26 2021] GET /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51 => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:26.475746 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-66b1a007-6d04-40ec-a368-33d03259cf7b req-f6d8d625-ace7-441b-af92-0ec82f96e9ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7abe3987-72d1-4833-86a4-001443048c51", "tag": "a322e5bf-88e1-4927-ae82-1bdc781c9029"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:47:26.479763 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:47:26.479763 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:47:26.494324 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-66b1a007-6d04-40ec-a368-33d03259cf7b req-f6d8d625-ace7-441b-af92-0ec82f96e9ca service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:26.495864 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-66b1a007-6d04-40ec-a368-33d03259cf7b req-f6d8d625-ace7-441b-af92-0ec82f96e9ca service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:26.507185 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-66b1a007-6d04-40ec-a368-33d03259cf7b req-f6d8d625-ace7-441b-af92-0ec82f96e9ca service nova] Creating event network-changed:a322e5bf-88e1-4927-ae82-1bdc781c9029 for instance 7abe3987-72d1-4833-86a4-001443048c51 on hv-cinder-68088 Nov 15 12:47:26.512715 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-66b1a007-6d04-40ec-a368-33d03259cf7b req-f6d8d625-ace7-441b-af92-0ec82f96e9ca service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046838 Nov 15 12:47:26.513306 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 503/1034] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:47:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 15 12:47:27.414174 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-b0226d04-a043-482a-a8ec-3658da437110 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:27.414799 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-b0226d04-a043-482a-a8ec-3658da437110 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 7abe3987-72d1-4833-86a4-001443048c51] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:27.422296 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b0226d04-a043-482a-a8ec-3658da437110 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:27.422699 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b0226d04-a043-482a-a8ec-3658da437110 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:27.424692 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b0226d04-a043-482a-a8ec-3658da437110 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:27.425159 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b0226d04-a043-482a-a8ec-3658da437110 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:27.824766 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-b0226d04-a043-482a-a8ec-3658da437110 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:27.831889 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-b0226d04-a043-482a-a8ec-3658da437110 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51" status: 200 len: 1317 microversion: 2.1 time: 0.421384 Nov 15 12:47:27.832451 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 532/1035] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:27 2021] GET /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51 => generated 1317 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:28.849715 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-7580c316-9e1d-4ebb-97ee-a41622a4f435 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:28.850404 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-7580c316-9e1d-4ebb-97ee-a41622a4f435 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 7abe3987-72d1-4833-86a4-001443048c51] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:28.857661 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7580c316-9e1d-4ebb-97ee-a41622a4f435 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:28.858102 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7580c316-9e1d-4ebb-97ee-a41622a4f435 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:28.858943 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7580c316-9e1d-4ebb-97ee-a41622a4f435 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:28.859372 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7580c316-9e1d-4ebb-97ee-a41622a4f435 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:28.999694 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-7580c316-9e1d-4ebb-97ee-a41622a4f435 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:29.006836 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-7580c316-9e1d-4ebb-97ee-a41622a4f435 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51" status: 200 len: 1317 microversion: 2.1 time: 0.161588 Nov 15 12:47:29.007419 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 504/1036] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:28 2021] GET /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:30.023840 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-058c302b-ab66-4377-aec7-52873b5906df tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:30.024448 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-058c302b-ab66-4377-aec7-52873b5906df tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 7abe3987-72d1-4833-86a4-001443048c51] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:30.031434 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-058c302b-ab66-4377-aec7-52873b5906df tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:30.031883 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-058c302b-ab66-4377-aec7-52873b5906df tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:30.032662 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-058c302b-ab66-4377-aec7-52873b5906df tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:30.033289 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-058c302b-ab66-4377-aec7-52873b5906df tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:30.188308 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-058c302b-ab66-4377-aec7-52873b5906df tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:30.198811 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-058c302b-ab66-4377-aec7-52873b5906df tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51" status: 200 len: 1317 microversion: 2.1 time: 0.175644 Nov 15 12:47:30.198811 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 533/1037] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:30 2021] GET /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:31.213041 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-bc27ccf3-c6f8-4f7c-99e3-7a2279902c46 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:31.213646 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-bc27ccf3-c6f8-4f7c-99e3-7a2279902c46 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 7abe3987-72d1-4833-86a4-001443048c51] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:31.220154 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bc27ccf3-c6f8-4f7c-99e3-7a2279902c46 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:31.220590 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bc27ccf3-c6f8-4f7c-99e3-7a2279902c46 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:31.221359 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bc27ccf3-c6f8-4f7c-99e3-7a2279902c46 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:31.221819 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bc27ccf3-c6f8-4f7c-99e3-7a2279902c46 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:31.352891 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-bc27ccf3-c6f8-4f7c-99e3-7a2279902c46 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:31.361265 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-bc27ccf3-c6f8-4f7c-99e3-7a2279902c46 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51" status: 200 len: 1317 microversion: 2.1 time: 0.151798 Nov 15 12:47:31.361842 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 505/1038] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:31 2021] GET /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:32.115746 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [req-8448cb45-252a-40b4-aa65-5009c9b8743b req-5ba3b54b-3a66-44ca-946e-e1ffeadec7f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7abe3987-72d1-4833-86a4-001443048c51", "name": "network-vif-plugged", "status": "completed", "tag": "a322e5bf-88e1-4927-ae82-1bdc781c9029"}]} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:47:32.117261 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:47:32.117261 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: warnings.warn(msg) Nov 15 12:47:32.126128 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-8448cb45-252a-40b4-aa65-5009c9b8743b req-5ba3b54b-3a66-44ca-946e-e1ffeadec7f1 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:32.126569 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-8448cb45-252a-40b4-aa65-5009c9b8743b req-5ba3b54b-3a66-44ca-946e-e1ffeadec7f1 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:32.140263 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.compute.server_external_events [req-8448cb45-252a-40b4-aa65-5009c9b8743b req-5ba3b54b-3a66-44ca-946e-e1ffeadec7f1 service nova] Creating event network-vif-plugged:a322e5bf-88e1-4927-ae82-1bdc781c9029 for instance 7abe3987-72d1-4833-86a4-001443048c51 on hv-cinder-68088 Nov 15 12:47:32.145327 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [req-8448cb45-252a-40b4-aa65-5009c9b8743b req-5ba3b54b-3a66-44ca-946e-e1ffeadec7f1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033306 Nov 15 12:47:32.146061 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 534/1039] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:47:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:47:32.379418 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-20809568-f45c-4bf8-85f9-9591b30ea89b tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:32.380024 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-20809568-f45c-4bf8-85f9-9591b30ea89b tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 7abe3987-72d1-4833-86a4-001443048c51] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:32.389248 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-20809568-f45c-4bf8-85f9-9591b30ea89b tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:32.389703 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-20809568-f45c-4bf8-85f9-9591b30ea89b tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:32.391529 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-20809568-f45c-4bf8-85f9-9591b30ea89b tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:32.392709 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-20809568-f45c-4bf8-85f9-9591b30ea89b tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:32.562152 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-20809568-f45c-4bf8-85f9-9591b30ea89b tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:32.571976 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-20809568-f45c-4bf8-85f9-9591b30ea89b tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51" status: 200 len: 1317 microversion: 2.1 time: 0.196045 Nov 15 12:47:32.576930 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 506/1040] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:32 2021] GET /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51 => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:33.593945 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-230d3778-81ac-4413-bb4c-09f80f7de960 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:33.594551 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-230d3778-81ac-4413-bb4c-09f80f7de960 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 7abe3987-72d1-4833-86a4-001443048c51] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:33.600693 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-230d3778-81ac-4413-bb4c-09f80f7de960 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:33.601143 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-230d3778-81ac-4413-bb4c-09f80f7de960 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:33.602586 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-230d3778-81ac-4413-bb4c-09f80f7de960 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:33.603230 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-230d3778-81ac-4413-bb4c-09f80f7de960 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:33.744648 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-230d3778-81ac-4413-bb4c-09f80f7de960 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:33.753334 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-230d3778-81ac-4413-bb4c-09f80f7de960 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51" status: 200 len: 1317 microversion: 2.1 time: 0.164195 Nov 15 12:47:33.753909 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 535/1041] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:33 2021] GET /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:34.769412 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-4cb4d239-8cc1-4da1-b42c-341898faa573 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:34.769995 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-4cb4d239-8cc1-4da1-b42c-341898faa573 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 7abe3987-72d1-4833-86a4-001443048c51] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:34.776549 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4cb4d239-8cc1-4da1-b42c-341898faa573 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:34.777451 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4cb4d239-8cc1-4da1-b42c-341898faa573 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:34.778236 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4cb4d239-8cc1-4da1-b42c-341898faa573 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:34.778665 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4cb4d239-8cc1-4da1-b42c-341898faa573 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:34.908067 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-4cb4d239-8cc1-4da1-b42c-341898faa573 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:34.915445 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-4cb4d239-8cc1-4da1-b42c-341898faa573 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51" status: 200 len: 1508 microversion: 2.1 time: 0.149723 Nov 15 12:47:34.916008 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 507/1042] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:34 2021] GET /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:35.137817 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-a10ee26c-810c-433e-a3cb-57686cb8d4c8 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:35.138909 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-a10ee26c-810c-433e-a3cb-57686cb8d4c8 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:35.145305 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a10ee26c-810c-433e-a3cb-57686cb8d4c8 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:35.145824 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a10ee26c-810c-433e-a3cb-57686cb8d4c8 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:35.146695 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a10ee26c-810c-433e-a3cb-57686cb8d4c8 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:35.147165 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a10ee26c-810c-433e-a3cb-57686cb8d4c8 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:35.180952 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-a10ee26c-810c-433e-a3cb-57686cb8d4c8 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045413 Nov 15 12:47:35.180952 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 536/1043] 10.222.0.43 () {60 vars in 1342 bytes} [Mon Nov 15 12:47:35 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:35.243180 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-a6a1a869-8290-4b34-a13f-cf25dec2b769 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:35.243666 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-a6a1a869-8290-4b34-a13f-cf25dec2b769 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:35.250286 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a6a1a869-8290-4b34-a13f-cf25dec2b769 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:35.250734 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a6a1a869-8290-4b34-a13f-cf25dec2b769 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:35.251532 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a6a1a869-8290-4b34-a13f-cf25dec2b769 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:35.251971 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a6a1a869-8290-4b34-a13f-cf25dec2b769 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:35.275960 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-a6a1a869-8290-4b34-a13f-cf25dec2b769 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Going to try to terminate instance {{(pid=122568) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 15 12:47:35.346294 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-2d943833-6126-4a85-a354-411b5f1cfac6 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:35.347042 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-2d943833-6126-4a85-a354-411b5f1cfac6 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:35.350430 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-a6a1a869-8290-4b34-a13f-cf25dec2b769 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "DELETE /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 204 len: 0 microversion: 2.20 time: 0.110607 Nov 15 12:47:35.355037 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 508/1044] 10.222.0.43 () {60 vars in 1279 bytes} [Mon Nov 15 12:47:35 2021] DELETE /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 15 12:47:35.355229 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2d943833-6126-4a85-a354-411b5f1cfac6 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:35.355229 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2d943833-6126-4a85-a354-411b5f1cfac6 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:35.355618 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2d943833-6126-4a85-a354-411b5f1cfac6 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:35.355978 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2d943833-6126-4a85-a354-411b5f1cfac6 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:35.361058 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-22c9fa95-1369-4dea-9318-d020db0c9b46 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:35.361747 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-22c9fa95-1369-4dea-9318-d020db0c9b46 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:35.367846 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-22c9fa95-1369-4dea-9318-d020db0c9b46 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:35.368284 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-22c9fa95-1369-4dea-9318-d020db0c9b46 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:35.369068 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-22c9fa95-1369-4dea-9318-d020db0c9b46 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:35.369490 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-22c9fa95-1369-4dea-9318-d020db0c9b46 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:35.382978 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-2d943833-6126-4a85-a354-411b5f1cfac6 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2] Going to try to terminate instance {{(pid=122567) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 15 12:47:35.464868 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-2d943833-6126-4a85-a354-411b5f1cfac6 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2" status: 204 len: 0 microversion: 2.1 time: 0.122887 Nov 15 12:47:35.468588 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 537/1045] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Nov 15 12:47:35 2021] DELETE /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 15 12:47:35.477215 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-28f14b3e-d4a8-4f94-9db0-7c3f07a3cce8 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:35.478800 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-28f14b3e-d4a8-4f94-9db0-7c3f07a3cce8 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:35.485798 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-28f14b3e-d4a8-4f94-9db0-7c3f07a3cce8 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:35.486345 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-28f14b3e-d4a8-4f94-9db0-7c3f07a3cce8 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:35.488866 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-28f14b3e-d4a8-4f94-9db0-7c3f07a3cce8 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:35.488866 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-28f14b3e-d4a8-4f94-9db0-7c3f07a3cce8 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:35.517371 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-22c9fa95-1369-4dea-9318-d020db0c9b46 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:35.525612 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-22c9fa95-1369-4dea-9318-d020db0c9b46 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:35.528237 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-22c9fa95-1369-4dea-9318-d020db0c9b46 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:35.529382 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-22c9fa95-1369-4dea-9318-d020db0c9b46 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1722 microversion: 2.20 time: 0.173088 Nov 15 12:47:35.529947 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 509/1046] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:47:35 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:47:35.627437 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-28f14b3e-d4a8-4f94-9db0-7c3f07a3cce8 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:35.635155 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-28f14b3e-d4a8-4f94-9db0-7c3f07a3cce8 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2" status: 200 len: 1580 microversion: 2.1 time: 0.162957 Nov 15 12:47:35.635823 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 538/1047] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:35 2021] GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2 => generated 1580 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:36.236128 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-76c6ca3f-4f65-4ced-bdcb-38ba27c1cc65 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6eed8fa0-9e37-46aa-8588-1319e50961f5"}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:47:36.237172 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-76c6ca3f-4f65-4ced-bdcb-38ba27c1cc65 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 7abe3987-72d1-4833-86a4-001443048c51] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:36.243115 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-76c6ca3f-4f65-4ced-bdcb-38ba27c1cc65 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:36.243568 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-76c6ca3f-4f65-4ced-bdcb-38ba27c1cc65 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:36.244319 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-76c6ca3f-4f65-4ced-bdcb-38ba27c1cc65 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:36.244752 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-76c6ca3f-4f65-4ced-bdcb-38ba27c1cc65 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:36.512324 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-76c6ca3f-4f65-4ced-bdcb-38ba27c1cc65 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "POST /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278418 Nov 15 12:47:36.513138 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 510/1048] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Nov 15 12:47:36 2021] POST /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:47:36.548107 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-cdc5f79e-a832-4cb7-876d-48f97fd0be50 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:36.548762 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-cdc5f79e-a832-4cb7-876d-48f97fd0be50 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:36.555430 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cdc5f79e-a832-4cb7-876d-48f97fd0be50 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:36.555840 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cdc5f79e-a832-4cb7-876d-48f97fd0be50 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:36.556636 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cdc5f79e-a832-4cb7-876d-48f97fd0be50 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:36.557210 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cdc5f79e-a832-4cb7-876d-48f97fd0be50 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:36.652958 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-a5ab130a-8b6c-4d72-b844-ed63cd4998ae tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:36.653856 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-a5ab130a-8b6c-4d72-b844-ed63cd4998ae tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:36.660508 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a5ab130a-8b6c-4d72-b844-ed63cd4998ae tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:36.660943 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a5ab130a-8b6c-4d72-b844-ed63cd4998ae tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:36.661716 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a5ab130a-8b6c-4d72-b844-ed63cd4998ae tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:36.662157 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a5ab130a-8b6c-4d72-b844-ed63cd4998ae tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:36.696577 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-cdc5f79e-a832-4cb7-876d-48f97fd0be50 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:36.705045 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-cdc5f79e-a832-4cb7-876d-48f97fd0be50 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:36.706725 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-cdc5f79e-a832-4cb7-876d-48f97fd0be50 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:36.708081 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-cdc5f79e-a832-4cb7-876d-48f97fd0be50 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1722 microversion: 2.20 time: 0.163833 Nov 15 12:47:36.710035 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 539/1049] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:47:36 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:47:36.804282 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-a5ab130a-8b6c-4d72-b844-ed63cd4998ae tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:36.812473 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-a5ab130a-8b6c-4d72-b844-ed63cd4998ae tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2" status: 200 len: 1580 microversion: 2.1 time: 0.163852 Nov 15 12:47:36.813078 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 511/1050] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:36 2021] GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2 => generated 1580 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:47:37.728533 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-0fb33e25-a41b-4adb-8859-de5c512527b4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:37.729550 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-0fb33e25-a41b-4adb-8859-de5c512527b4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:37.736536 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0fb33e25-a41b-4adb-8859-de5c512527b4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:37.737439 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0fb33e25-a41b-4adb-8859-de5c512527b4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:37.738267 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0fb33e25-a41b-4adb-8859-de5c512527b4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:37.738703 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0fb33e25-a41b-4adb-8859-de5c512527b4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:37.830073 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-c16d3cff-a20f-4698-a5ec-9ea02adbe2d0 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:37.830607 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-c16d3cff-a20f-4698-a5ec-9ea02adbe2d0 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:37.837238 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c16d3cff-a20f-4698-a5ec-9ea02adbe2d0 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:37.837682 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c16d3cff-a20f-4698-a5ec-9ea02adbe2d0 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:37.838471 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c16d3cff-a20f-4698-a5ec-9ea02adbe2d0 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:37.839581 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c16d3cff-a20f-4698-a5ec-9ea02adbe2d0 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:38.005928 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-0fb33e25-a41b-4adb-8859-de5c512527b4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:38.020211 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-0fb33e25-a41b-4adb-8859-de5c512527b4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:38.022111 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-0fb33e25-a41b-4adb-8859-de5c512527b4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:38.023454 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-0fb33e25-a41b-4adb-8859-de5c512527b4 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1722 microversion: 2.20 time: 0.299445 Nov 15 12:47:38.024718 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 540/1051] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:47:37 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1722 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:47:38.216184 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-c16d3cff-a20f-4698-a5ec-9ea02adbe2d0 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:38.226034 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-c16d3cff-a20f-4698-a5ec-9ea02adbe2d0 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2" status: 200 len: 1580 microversion: 2.1 time: 0.399542 Nov 15 12:47:38.236344 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 512/1052] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:37 2021] GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2 => generated 1580 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:47:38.748259 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-4890e143-e969-44cf-8946-f35733080dd2 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6eed8fa0-9e37-46aa-8588-1319e50961f5"}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:47:38.749987 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-4890e143-e969-44cf-8946-f35733080dd2 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 7abe3987-72d1-4833-86a4-001443048c51] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:38.757643 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4890e143-e969-44cf-8946-f35733080dd2 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:38.758287 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4890e143-e969-44cf-8946-f35733080dd2 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:38.759681 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4890e143-e969-44cf-8946-f35733080dd2 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:38.760281 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4890e143-e969-44cf-8946-f35733080dd2 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:38.816084 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-de6da966-c4ea-48e9-9a04-9adb8081f3ae req-de6cf941-2d5a-4747-b843-afc7e75cfb39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12e0ab18-a841-4228-bebb-1c5d1db6f7f6", "name": "network-vif-deleted", "tag": "ffefc1bf-d747-45f6-8979-9a984c11ed67"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:47:38.818118 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:47:38.818118 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:47:38.828867 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-de6da966-c4ea-48e9-9a04-9adb8081f3ae req-de6cf941-2d5a-4747-b843-afc7e75cfb39 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:38.829307 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-de6da966-c4ea-48e9-9a04-9adb8081f3ae req-de6cf941-2d5a-4747-b843-afc7e75cfb39 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:38.845093 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-de6da966-c4ea-48e9-9a04-9adb8081f3ae req-de6cf941-2d5a-4747-b843-afc7e75cfb39 service nova] Creating event network-vif-deleted:ffefc1bf-d747-45f6-8979-9a984c11ed67 for instance 12e0ab18-a841-4228-bebb-1c5d1db6f7f6 on hv-cinder-68088 Nov 15 12:47:38.853973 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-de6da966-c4ea-48e9-9a04-9adb8081f3ae req-de6cf941-2d5a-4747-b843-afc7e75cfb39 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042757 Nov 15 12:47:38.857653 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 513/1053] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:47:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 15 12:47:38.894562 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.wsgi [None req-4890e143-e969-44cf-8946-f35733080dd2 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] HTTP exception thrown: Invalid volume: volume 6eed8fa0-9e37-46aa-8588-1319e50961f5 is already attached to instances: 7abe3987-72d1-4833-86a4-001443048c51 Nov 15 12:47:38.895651 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-4890e143-e969-44cf-8946-f35733080dd2 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Returning 400 to user: Invalid volume: volume 6eed8fa0-9e37-46aa-8588-1319e50961f5 is already attached to instances: 7abe3987-72d1-4833-86a4-001443048c51 {{(pid=122567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:47:38.907061 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-4890e143-e969-44cf-8946-f35733080dd2 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "POST /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.153813 Nov 15 12:47:38.912461 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 541/1054] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Nov 15 12:47:38 2021] POST /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51/os-volume_attachments => generated 174 bytes in 170 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 15 12:47:39.007118 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-a21fa2c2-707e-42db-b795-26677332bad8 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:39.007699 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-a21fa2c2-707e-42db-b795-26677332bad8 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 7abe3987-72d1-4833-86a4-001443048c51] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:39.018064 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a21fa2c2-707e-42db-b795-26677332bad8 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:39.018517 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a21fa2c2-707e-42db-b795-26677332bad8 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:39.019380 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a21fa2c2-707e-42db-b795-26677332bad8 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:39.020006 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a21fa2c2-707e-42db-b795-26677332bad8 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:39.045530 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [req-70549f7e-e7a8-40de-ac43-9744f46355db req-41acc310-6237-4422-a8f2-6616f11518c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2", "name": "network-vif-deleted", "tag": "e4e6fc76-abc6-4e8a-8982-935e5e678851"}]} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:47:39.049950 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:47:39.049950 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: warnings.warn(msg) Nov 15 12:47:39.083630 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-70549f7e-e7a8-40de-ac43-9744f46355db req-41acc310-6237-4422-a8f2-6616f11518c7 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:39.084069 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-70549f7e-e7a8-40de-ac43-9744f46355db req-41acc310-6237-4422-a8f2-6616f11518c7 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:39.125453 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.compute.server_external_events [req-70549f7e-e7a8-40de-ac43-9744f46355db req-41acc310-6237-4422-a8f2-6616f11518c7 service nova] Creating event network-vif-deleted:e4e6fc76-abc6-4e8a-8982-935e5e678851 for instance f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2 on hv-cinder-68088 Nov 15 12:47:39.135086 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [req-70549f7e-e7a8-40de-ac43-9744f46355db req-41acc310-6237-4422-a8f2-6616f11518c7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096215 Nov 15 12:47:39.141113 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 542/1055] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:47:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:47:39.148158 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-b6bf4f35-7a79-4af4-b5df-4fcf404c53d9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:39.149239 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-b6bf4f35-7a79-4af4-b5df-4fcf404c53d9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:39.157393 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b6bf4f35-7a79-4af4-b5df-4fcf404c53d9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:39.158084 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b6bf4f35-7a79-4af4-b5df-4fcf404c53d9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:39.159101 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b6bf4f35-7a79-4af4-b5df-4fcf404c53d9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:39.159713 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b6bf4f35-7a79-4af4-b5df-4fcf404c53d9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:39.203293 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b6bf4f35-7a79-4af4-b5df-4fcf404c53d9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:39.203941 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b6bf4f35-7a79-4af4-b5df-4fcf404c53d9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:39.205252 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.objects.instance [None req-b6bf4f35-7a79-4af4-b5df-4fcf404c53d9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lazy-loading 'fault' on Instance uuid 12e0ab18-a841-4228-bebb-1c5d1db6f7f6 {{(pid=122567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 15 12:47:39.256166 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-b6bf4f35-7a79-4af4-b5df-4fcf404c53d9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:39.273208 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-b6bf4f35-7a79-4af4-b5df-4fcf404c53d9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:39.275004 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.objects.instance [None req-a21fa2c2-707e-42db-b795-26677332bad8 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lazy-loading 'services' on Instance uuid 7abe3987-72d1-4833-86a4-001443048c51 {{(pid=122568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 15 12:47:39.275185 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-b6bf4f35-7a79-4af4-b5df-4fcf404c53d9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93fd9736646548b383d0c2600219c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d24506f5a47d0925645d4303dac8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:39.277891 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-b6bf4f35-7a79-4af4-b5df-4fcf404c53d9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 200 len: 1371 microversion: 2.20 time: 0.134631 Nov 15 12:47:39.281538 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 543/1056] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:47:39 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 1371 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 15 12:47:39.295052 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-74417079-b6c5-457e-96b6-ba77bcc171e9 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:39.295683 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-74417079-b6c5-457e-96b6-ba77bcc171e9 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:39.312657 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-74417079-b6c5-457e-96b6-ba77bcc171e9 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:39.313167 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-74417079-b6c5-457e-96b6-ba77bcc171e9 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:39.314254 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-74417079-b6c5-457e-96b6-ba77bcc171e9 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:39.314976 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-74417079-b6c5-457e-96b6-ba77bcc171e9 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:39.373783 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-a21fa2c2-707e-42db-b795-26677332bad8 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51/os-volume_attachments/6eed8fa0-9e37-46aa-8588-1319e50961f5" status: 202 len: 0 microversion: 2.1 time: 0.371902 Nov 15 12:47:39.377834 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 514/1057] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Nov 15 12:47:39 2021] DELETE /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51/os-volume_attachments/6eed8fa0-9e37-46aa-8588-1319e50961f5 => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:47:39.384764 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-e17e649b-d0f5-4c44-b64b-be97e0203899 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:39.386353 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-e17e649b-d0f5-4c44-b64b-be97e0203899 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 7abe3987-72d1-4833-86a4-001443048c51] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:39.398039 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e17e649b-d0f5-4c44-b64b-be97e0203899 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:39.398688 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e17e649b-d0f5-4c44-b64b-be97e0203899 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:39.400536 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e17e649b-d0f5-4c44-b64b-be97e0203899 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:39.401815 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-e17e649b-d0f5-4c44-b64b-be97e0203899 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:39.419484 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-74417079-b6c5-457e-96b6-ba77bcc171e9 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:39.436950 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-74417079-b6c5-457e-96b6-ba77bcc171e9 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2" status: 200 len: 1226 microversion: 2.1 time: 0.147439 Nov 15 12:47:39.440589 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 544/1058] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:39 2021] GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2 => generated 1226 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:39.465701 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-e17e649b-d0f5-4c44-b64b-be97e0203899 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086058 Nov 15 12:47:39.466300 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 515/1059] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Nov 15 12:47:39 2021] GET /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:47:40.298819 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-aae5daca-527c-41d5-86af-7a5a184f7540 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:40.301026 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-aae5daca-527c-41d5-86af-7a5a184f7540 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:40.308633 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-aae5daca-527c-41d5-86af-7a5a184f7540 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:40.309086 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-aae5daca-527c-41d5-86af-7a5a184f7540 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:40.309880 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-aae5daca-527c-41d5-86af-7a5a184f7540 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:40.310314 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-aae5daca-527c-41d5-86af-7a5a184f7540 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:40.324667 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.wsgi [None req-aae5daca-527c-41d5-86af-7a5a184f7540 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] HTTP exception thrown: Instance 12e0ab18-a841-4228-bebb-1c5d1db6f7f6 could not be found. Nov 15 12:47:40.325280 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-aae5daca-527c-41d5-86af-7a5a184f7540 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Returning 404 to user: Instance 12e0ab18-a841-4228-bebb-1c5d1db6f7f6 could not be found. {{(pid=122567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:47:40.326205 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-aae5daca-527c-41d5-86af-7a5a184f7540 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 404 len: 111 microversion: 2.20 time: 0.034558 Nov 15 12:47:40.326890 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 545/1060] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Nov 15 12:47:40 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 15 12:47:40.335409 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-15bb9c4d-545e-4d61-844e-3c69764c15e1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '.version_select at 0x7f131b2bb940>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:40.355917 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-15bb9c4d-545e-4d61-844e-3c69764c15e1 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-177013178" status: 204 len: 0 microversion: 2.20 time: 0.024115 Nov 15 12:47:40.356784 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 516/1061] 10.222.0.43 () {60 vars in 1258 bytes} [Mon Nov 15 12:47:40 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-177013178 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 15 12:47:40.460605 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-7d1d1184-33f0-47bb-8ffb-8a3d7cb13ba2 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:40.461877 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-7d1d1184-33f0-47bb-8ffb-8a3d7cb13ba2 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:40.474737 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7d1d1184-33f0-47bb-8ffb-8a3d7cb13ba2 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:40.475319 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7d1d1184-33f0-47bb-8ffb-8a3d7cb13ba2 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:40.476597 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7d1d1184-33f0-47bb-8ffb-8a3d7cb13ba2 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:40.477203 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7d1d1184-33f0-47bb-8ffb-8a3d7cb13ba2 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:40.477341 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-027681b4-b59a-4fd0-8454-8c967915bd69 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:40.478253 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-027681b4-b59a-4fd0-8454-8c967915bd69 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 7abe3987-72d1-4833-86a4-001443048c51] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:40.485661 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-027681b4-b59a-4fd0-8454-8c967915bd69 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:40.486460 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-027681b4-b59a-4fd0-8454-8c967915bd69 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:40.487291 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-027681b4-b59a-4fd0-8454-8c967915bd69 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:40.487719 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-027681b4-b59a-4fd0-8454-8c967915bd69 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:40.506136 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.wsgi [None req-7d1d1184-33f0-47bb-8ffb-8a3d7cb13ba2 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] HTTP exception thrown: Instance f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2 could not be found. Nov 15 12:47:40.507512 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-7d1d1184-33f0-47bb-8ffb-8a3d7cb13ba2 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Returning 404 to user: Instance f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2 could not be found. {{(pid=122567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:47:40.508925 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-7d1d1184-33f0-47bb-8ffb-8a3d7cb13ba2 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2" status: 404 len: 111 microversion: 2.1 time: 0.053083 Nov 15 12:47:40.523712 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 546/1062] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:40 2021] GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 15 12:47:40.536112 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-027681b4-b59a-4fd0-8454-8c967915bd69 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062207 Nov 15 12:47:40.541315 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 517/1063] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Nov 15 12:47:40 2021] GET /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 15 12:47:40.678624 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-799234bd-2c17-4fbd-903f-a62364f81582 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1613995534", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1935274887", "security_groups": [{"name": "tempest-secgroup-smoke-1331826370"}], "block_device_mapping_v2": [{"uuid": "aa5f8226-b6ac-42dc-b928-eb2e166f7436", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f4599fcb-fdea-4045-9c9c-3e445269e7ec"}]}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:47:40.827641 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.network.neutron [None req-799234bd-2c17-4fbd-903f-a62364f81582 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] validate_networks() for [('f4599fcb-fdea-4045-9c9c-3e445269e7ec', None, None, None, None, None)] {{(pid=122567) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 15 12:47:41.372418 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-799234bd-2c17-4fbd-903f-a62364f81582 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Flavor limits 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 15 12:47:41.372999 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-799234bd-2c17-4fbd-903f-a62364f81582 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Image limits 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 15 12:47:41.373386 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-799234bd-2c17-4fbd-903f-a62364f81582 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Flavor pref 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 15 12:47:41.373971 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-799234bd-2c17-4fbd-903f-a62364f81582 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Image pref 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 15 12:47:41.374201 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-799234bd-2c17-4fbd-903f-a62364f81582 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 15 12:47:41.383390 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-799234bd-2c17-4fbd-903f-a62364f81582 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:41.383926 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-799234bd-2c17-4fbd-903f-a62364f81582 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:41.384728 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-799234bd-2c17-4fbd-903f-a62364f81582 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:41.385171 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-799234bd-2c17-4fbd-903f-a62364f81582 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:41.403278 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.quota [None req-799234bd-2c17-4fbd-903f-a62364f81582 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Getting quotas for project f78fedf356a24ea182428c85682330f1. Resources: {'cores', 'ram', 'instances'} {{(pid=122567) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:47:41.409130 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.quota [None req-799234bd-2c17-4fbd-903f-a62364f81582 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Getting quotas for user 84c8f2a4f7c84026859778c12d6f7c35 and project f78fedf356a24ea182428c85682330f1. Resources: {'cores', 'ram', 'instances'} {{(pid=122567) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:47:41.467139 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-799234bd-2c17-4fbd-903f-a62364f81582 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Going to run 1 instances... {{(pid=122567) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 15 12:47:41.469344 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-799234bd-2c17-4fbd-903f-a62364f81582 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 012358cb-bdcf-4afc-b480-5399958e82df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aa5f8226-b6ac-42dc-b928-eb2e166f7436',volume_size=None,volume_type=None)] {{(pid=122567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 15 12:47:41.549532 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-3314cf03-cee2-400b-941c-5a55a09c79b9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:41.550470 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-3314cf03-cee2-400b-941c-5a55a09c79b9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 7abe3987-72d1-4833-86a4-001443048c51] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:41.557005 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3314cf03-cee2-400b-941c-5a55a09c79b9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:41.557474 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3314cf03-cee2-400b-941c-5a55a09c79b9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:41.558252 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3314cf03-cee2-400b-941c-5a55a09c79b9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:41.558672 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3314cf03-cee2-400b-941c-5a55a09c79b9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:41.587659 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-3314cf03-cee2-400b-941c-5a55a09c79b9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041849 Nov 15 12:47:41.588221 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 518/1064] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Nov 15 12:47:41 2021] GET /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 15 12:47:41.606866 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-799234bd-2c17-4fbd-903f-a62364f81582 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.931741 Nov 15 12:47:41.607531 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 547/1065] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Nov 15 12:47:40 2021] POST /compute/v2.1/servers => generated 406 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 15 12:47:41.617718 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-49a998c4-f496-49a3-866f-03cbd52b840b tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:41.618400 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-49a998c4-f496-49a3-866f-03cbd52b840b tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 012358cb-bdcf-4afc-b480-5399958e82df] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:41.680529 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-49a998c4-f496-49a3-866f-03cbd52b840b tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:41.687304 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-49a998c4-f496-49a3-866f-03cbd52b840b tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df" status: 200 len: 1095 microversion: 2.1 time: 0.073257 Nov 15 12:47:41.688197 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 519/1066] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:41 2021] GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df => generated 1095 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:41.709121 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-a0ec4b51-0333-4a0d-b4de-7b6d422b4c9e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-615303552", "imageRef": "3cc21e2c-27da-4266-be76-369023341c16", "flavorRef": "452", "networks": [{"uuid": "b5e792a7-3bc7-401c-8890-d6bf3bed54f7"}]}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:47:41.764286 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.network.neutron [None req-a0ec4b51-0333-4a0d-b4de-7b6d422b4c9e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] validate_networks() for [('b5e792a7-3bc7-401c-8890-d6bf3bed54f7', None, None, None, None, None)] {{(pid=122567) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 15 12:47:42.180805 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-a0ec4b51-0333-4a0d-b4de-7b6d422b4c9e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Flavor limits 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 15 12:47:42.181310 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-a0ec4b51-0333-4a0d-b4de-7b6d422b4c9e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Image limits 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 15 12:47:42.181790 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-a0ec4b51-0333-4a0d-b4de-7b6d422b4c9e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Flavor pref 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 15 12:47:42.182202 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-a0ec4b51-0333-4a0d-b4de-7b6d422b4c9e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Image pref 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 15 12:47:42.182840 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-a0ec4b51-0333-4a0d-b4de-7b6d422b4c9e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 15 12:47:42.191759 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a0ec4b51-0333-4a0d-b4de-7b6d422b4c9e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:42.192210 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a0ec4b51-0333-4a0d-b4de-7b6d422b4c9e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:42.193085 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a0ec4b51-0333-4a0d-b4de-7b6d422b4c9e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:42.193518 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a0ec4b51-0333-4a0d-b4de-7b6d422b4c9e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:42.212631 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.quota [None req-a0ec4b51-0333-4a0d-b4de-7b6d422b4c9e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Getting quotas for project 8b023f637e184e67bccf0ed11a6a802d. Resources: {'cores', 'ram', 'instances'} {{(pid=122567) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:47:42.218217 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.quota [None req-a0ec4b51-0333-4a0d-b4de-7b6d422b4c9e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Getting quotas for user ca6612e1905c4e70b39aaa552b9de730 and project 8b023f637e184e67bccf0ed11a6a802d. Resources: {'cores', 'ram', 'instances'} {{(pid=122567) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:47:42.230893 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-a0ec4b51-0333-4a0d-b4de-7b6d422b4c9e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Going to run 1 instances... {{(pid=122567) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 15 12:47:42.233136 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-a0ec4b51-0333-4a0d-b4de-7b6d422b4c9e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 19636bbd-b763-4071-9f3f-5b6bd9f5d7a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3cc21e2c-27da-4266-be76-369023341c16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 15 12:47:42.281010 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-a0ec4b51-0333-4a0d-b4de-7b6d422b4c9e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575568 Nov 15 12:47:42.281864 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 548/1067] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Nov 15 12:47:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 15 12:47:42.291218 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-115f6810-4c4e-4116-8730-0c7fee9ae6f2 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:42.291943 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-115f6810-4c4e-4116-8730-0c7fee9ae6f2 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 19636bbd-b763-4071-9f3f-5b6bd9f5d7a1] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:42.344231 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-115f6810-4c4e-4116-8730-0c7fee9ae6f2 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:42.351414 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-115f6810-4c4e-4116-8730-0c7fee9ae6f2 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1" status: 200 len: 1217 microversion: 2.1 time: 0.063795 Nov 15 12:47:42.351976 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 520/1068] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:42 2021] GET /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1 => generated 1217 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:42.429936 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-9877c062-2e31-48c6-8a8b-a427ef1da12b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:42.430520 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-9877c062-2e31-48c6-8a8b-a427ef1da12b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:42.436623 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9877c062-2e31-48c6-8a8b-a427ef1da12b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:42.437073 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9877c062-2e31-48c6-8a8b-a427ef1da12b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:42.437925 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9877c062-2e31-48c6-8a8b-a427ef1da12b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:42.438371 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9877c062-2e31-48c6-8a8b-a427ef1da12b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:42.452338 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.wsgi [None req-9877c062-2e31-48c6-8a8b-a427ef1da12b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] HTTP exception thrown: Instance 12e0ab18-a841-4228-bebb-1c5d1db6f7f6 could not be found. Nov 15 12:47:42.452917 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-9877c062-2e31-48c6-8a8b-a427ef1da12b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Returning 404 to user: Instance 12e0ab18-a841-4228-bebb-1c5d1db6f7f6 could not be found. {{(pid=122567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:47:42.453738 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-9877c062-2e31-48c6-8a8b-a427ef1da12b tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "DELETE /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 404 len: 111 microversion: 2.1 time: 0.027956 Nov 15 12:47:42.454282 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 549/1069] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Nov 15 12:47:42 2021] DELETE /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 15 12:47:42.462025 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-a303eff8-3a21-436d-922f-480784b1daab tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:42.462710 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-a303eff8-3a21-436d-922f-480784b1daab tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 12e0ab18-a841-4228-bebb-1c5d1db6f7f6] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:42.469653 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a303eff8-3a21-436d-922f-480784b1daab tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:42.470358 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a303eff8-3a21-436d-922f-480784b1daab tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:42.471193 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a303eff8-3a21-436d-922f-480784b1daab tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:42.471623 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a303eff8-3a21-436d-922f-480784b1daab tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:42.487108 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.wsgi [None req-a303eff8-3a21-436d-922f-480784b1daab tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] HTTP exception thrown: Instance 12e0ab18-a841-4228-bebb-1c5d1db6f7f6 could not be found. Nov 15 12:47:42.487696 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-a303eff8-3a21-436d-922f-480784b1daab tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Returning 404 to user: Instance 12e0ab18-a841-4228-bebb-1c5d1db6f7f6 could not be found. {{(pid=122568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:47:42.488512 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-a303eff8-3a21-436d-922f-480784b1daab tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6" status: 404 len: 111 microversion: 2.1 time: 0.030107 Nov 15 12:47:42.489287 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 521/1070] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:42 2021] GET /compute/v2.1/servers/12e0ab18-a841-4228-bebb-1c5d1db6f7f6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 15 12:47:42.704766 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-bbc2a1f2-cce3-4587-a40e-63aa8914ac87 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:42.705283 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-bbc2a1f2-cce3-4587-a40e-63aa8914ac87 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 012358cb-bdcf-4afc-b480-5399958e82df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:42.711344 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bbc2a1f2-cce3-4587-a40e-63aa8914ac87 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:42.711807 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bbc2a1f2-cce3-4587-a40e-63aa8914ac87 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:42.712564 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bbc2a1f2-cce3-4587-a40e-63aa8914ac87 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:42.713003 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-bbc2a1f2-cce3-4587-a40e-63aa8914ac87 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:42.779070 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-bbc2a1f2-cce3-4587-a40e-63aa8914ac87 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:42.786686 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-bbc2a1f2-cce3-4587-a40e-63aa8914ac87 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df" status: 200 len: 1201 microversion: 2.1 time: 0.085746 Nov 15 12:47:42.787286 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 550/1071] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:42 2021] GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df => generated 1201 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:43.368934 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-135e0c39-ff56-477c-beae-508942e565c8 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:43.369481 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-135e0c39-ff56-477c-beae-508942e565c8 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 19636bbd-b763-4071-9f3f-5b6bd9f5d7a1] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:43.376008 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-135e0c39-ff56-477c-beae-508942e565c8 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:43.376459 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-135e0c39-ff56-477c-beae-508942e565c8 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:43.377249 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-135e0c39-ff56-477c-beae-508942e565c8 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:43.377682 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-135e0c39-ff56-477c-beae-508942e565c8 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:43.460196 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-135e0c39-ff56-477c-beae-508942e565c8 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:43.470548 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-135e0c39-ff56-477c-beae-508942e565c8 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1" status: 200 len: 1269 microversion: 2.1 time: 0.105298 Nov 15 12:47:43.471324 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 522/1072] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:43 2021] GET /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1 => generated 1269 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:43.635980 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-68aa7715-8924-426b-a0c9-1a4bc78e49d9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:43.637319 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-68aa7715-8924-426b-a0c9-1a4bc78e49d9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:43.649451 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-68aa7715-8924-426b-a0c9-1a4bc78e49d9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:43.650160 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-68aa7715-8924-426b-a0c9-1a4bc78e49d9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:43.657444 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-68aa7715-8924-426b-a0c9-1a4bc78e49d9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:43.658454 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-68aa7715-8924-426b-a0c9-1a4bc78e49d9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:43.685725 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.wsgi [None req-68aa7715-8924-426b-a0c9-1a4bc78e49d9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] HTTP exception thrown: Instance 11daa0bc-1e25-47d7-a6df-ffc808e1ff58 could not be found. Nov 15 12:47:43.686618 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-68aa7715-8924-426b-a0c9-1a4bc78e49d9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Returning 404 to user: Instance 11daa0bc-1e25-47d7-a6df-ffc808e1ff58 could not be found. {{(pid=122567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:47:43.690074 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-68aa7715-8924-426b-a0c9-1a4bc78e49d9 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "DELETE /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 404 len: 111 microversion: 2.1 time: 0.056386 Nov 15 12:47:43.691339 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 551/1073] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Nov 15 12:47:43 2021] DELETE /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 15 12:47:43.699862 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-b76b378f-b63a-4420-abb3-8890687d3026 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:43.701050 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-b76b378f-b63a-4420-abb3-8890687d3026 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] [instance: 11daa0bc-1e25-47d7-a6df-ffc808e1ff58] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:43.709129 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b76b378f-b63a-4420-abb3-8890687d3026 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:43.709971 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b76b378f-b63a-4420-abb3-8890687d3026 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:43.711206 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b76b378f-b63a-4420-abb3-8890687d3026 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:43.712378 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b76b378f-b63a-4420-abb3-8890687d3026 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:43.736797 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.wsgi [None req-b76b378f-b63a-4420-abb3-8890687d3026 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] HTTP exception thrown: Instance 11daa0bc-1e25-47d7-a6df-ffc808e1ff58 could not be found. Nov 15 12:47:43.737845 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-b76b378f-b63a-4420-abb3-8890687d3026 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] Returning 404 to user: Instance 11daa0bc-1e25-47d7-a6df-ffc808e1ff58 could not be found. {{(pid=122568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:47:43.738949 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-b76b378f-b63a-4420-abb3-8890687d3026 tempest-AttachVolumeShelveTestJSON-1723634675 tempest-AttachVolumeShelveTestJSON-1723634675-project] 10.222.0.43 "GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58" status: 404 len: 111 microversion: 2.1 time: 0.043759 Nov 15 12:47:43.741003 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 523/1074] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:43 2021] GET /compute/v2.1/servers/11daa0bc-1e25-47d7-a6df-ffc808e1ff58 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 15 12:47:43.805443 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-ab0c4d82-e478-4ce9-995a-33b45a5f7564 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:43.806061 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-ab0c4d82-e478-4ce9-995a-33b45a5f7564 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 012358cb-bdcf-4afc-b480-5399958e82df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:43.813382 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ab0c4d82-e478-4ce9-995a-33b45a5f7564 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:43.814140 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ab0c4d82-e478-4ce9-995a-33b45a5f7564 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:43.815357 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ab0c4d82-e478-4ce9-995a-33b45a5f7564 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:43.816147 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ab0c4d82-e478-4ce9-995a-33b45a5f7564 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:44.021357 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-ab0c4d82-e478-4ce9-995a-33b45a5f7564 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:44.030908 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-ab0c4d82-e478-4ce9-995a-33b45a5f7564 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df" status: 200 len: 1267 microversion: 2.1 time: 0.229045 Nov 15 12:47:44.031796 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 552/1075] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:43 2021] GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df => generated 1267 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:44.490319 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-a03c1573-25bb-415e-be4c-98d69d75264e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:44.491705 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-a03c1573-25bb-415e-be4c-98d69d75264e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 19636bbd-b763-4071-9f3f-5b6bd9f5d7a1] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:44.502207 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a03c1573-25bb-415e-be4c-98d69d75264e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:44.503048 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a03c1573-25bb-415e-be4c-98d69d75264e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:44.504600 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a03c1573-25bb-415e-be4c-98d69d75264e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:44.505827 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a03c1573-25bb-415e-be4c-98d69d75264e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:44.816012 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-a03c1573-25bb-415e-be4c-98d69d75264e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:44.827370 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-a03c1573-25bb-415e-be4c-98d69d75264e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1" status: 200 len: 1317 microversion: 2.1 time: 0.342520 Nov 15 12:47:44.828755 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 524/1076] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:44 2021] GET /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1 => generated 1317 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:45.052106 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-103cc544-7752-4d47-ae89-d305b98a41fb tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:45.053730 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-103cc544-7752-4d47-ae89-d305b98a41fb tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 012358cb-bdcf-4afc-b480-5399958e82df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:45.065903 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-486f5804-f9f3-474c-a24e-dc46ea5ca682 req-b0c423ce-225c-4b1a-b53a-a080c9765b8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "012358cb-bdcf-4afc-b480-5399958e82df", "tag": "471bc66e-1316-423a-b9d0-fa99991998d4"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:47:45.068298 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:47:45.068298 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:47:45.072268 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-103cc544-7752-4d47-ae89-d305b98a41fb tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:45.074599 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-103cc544-7752-4d47-ae89-d305b98a41fb tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:45.078619 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-486f5804-f9f3-474c-a24e-dc46ea5ca682 req-b0c423ce-225c-4b1a-b53a-a080c9765b8f service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:45.079974 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-103cc544-7752-4d47-ae89-d305b98a41fb tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:45.080651 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-103cc544-7752-4d47-ae89-d305b98a41fb tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:45.091183 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-486f5804-f9f3-474c-a24e-dc46ea5ca682 req-b0c423ce-225c-4b1a-b53a-a080c9765b8f service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:45.126759 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-486f5804-f9f3-474c-a24e-dc46ea5ca682 req-b0c423ce-225c-4b1a-b53a-a080c9765b8f service nova] Creating event network-changed:471bc66e-1316-423a-b9d0-fa99991998d4 for instance 012358cb-bdcf-4afc-b480-5399958e82df on hv-cinder-68088 Nov 15 12:47:45.132538 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-486f5804-f9f3-474c-a24e-dc46ea5ca682 req-b0c423ce-225c-4b1a-b53a-a080c9765b8f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070027 Nov 15 12:47:45.133654 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 525/1077] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:47:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:47:45.580658 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-103cc544-7752-4d47-ae89-d305b98a41fb tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:45.590004 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-103cc544-7752-4d47-ae89-d305b98a41fb tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df" status: 200 len: 1267 microversion: 2.1 time: 0.541476 Nov 15 12:47:45.590956 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 553/1078] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:45 2021] GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df => generated 1267 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:45.701578 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-bbd1f1d3-6be1-4f16-9fa5-328c1a5c07be req-7c6716f7-4e44-4fc4-ad39-ea4ca4270615 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19636bbd-b763-4071-9f3f-5b6bd9f5d7a1", "tag": "dd7e7436-7fa2-46fb-a2c6-5d719d4dac18"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:47:45.703565 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:47:45.703565 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:47:45.714160 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-bbd1f1d3-6be1-4f16-9fa5-328c1a5c07be req-7c6716f7-4e44-4fc4-ad39-ea4ca4270615 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:45.715074 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-bbd1f1d3-6be1-4f16-9fa5-328c1a5c07be req-7c6716f7-4e44-4fc4-ad39-ea4ca4270615 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:45.742156 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-bbd1f1d3-6be1-4f16-9fa5-328c1a5c07be req-7c6716f7-4e44-4fc4-ad39-ea4ca4270615 service nova] Creating event network-changed:dd7e7436-7fa2-46fb-a2c6-5d719d4dac18 for instance 19636bbd-b763-4071-9f3f-5b6bd9f5d7a1 on hv-cinder-68088 Nov 15 12:47:45.748167 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-bbd1f1d3-6be1-4f16-9fa5-328c1a5c07be req-7c6716f7-4e44-4fc4-ad39-ea4ca4270615 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052432 Nov 15 12:47:45.748775 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 526/1079] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:47:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 15 12:47:45.847241 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-2540bb1d-6ad1-45ac-bcd9-95438c16b2b2 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:45.848190 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-2540bb1d-6ad1-45ac-bcd9-95438c16b2b2 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 19636bbd-b763-4071-9f3f-5b6bd9f5d7a1] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:45.856981 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2540bb1d-6ad1-45ac-bcd9-95438c16b2b2 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:45.857844 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2540bb1d-6ad1-45ac-bcd9-95438c16b2b2 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:45.858890 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2540bb1d-6ad1-45ac-bcd9-95438c16b2b2 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:45.859559 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2540bb1d-6ad1-45ac-bcd9-95438c16b2b2 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:46.091093 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-2540bb1d-6ad1-45ac-bcd9-95438c16b2b2 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:46.101507 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-2540bb1d-6ad1-45ac-bcd9-95438c16b2b2 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1" status: 200 len: 1317 microversion: 2.1 time: 0.258296 Nov 15 12:47:46.104568 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 554/1080] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:45 2021] GET /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1 => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:46.610078 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-97f18bf2-dea2-4d35-b1b6-a4069148b844 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:46.610793 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-97f18bf2-dea2-4d35-b1b6-a4069148b844 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 012358cb-bdcf-4afc-b480-5399958e82df] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:46.616832 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-97f18bf2-dea2-4d35-b1b6-a4069148b844 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:46.617475 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-97f18bf2-dea2-4d35-b1b6-a4069148b844 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:46.618246 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-97f18bf2-dea2-4d35-b1b6-a4069148b844 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:46.618667 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-97f18bf2-dea2-4d35-b1b6-a4069148b844 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:46.849128 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-97f18bf2-dea2-4d35-b1b6-a4069148b844 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:46.857189 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-97f18bf2-dea2-4d35-b1b6-a4069148b844 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df" status: 200 len: 1267 microversion: 2.1 time: 0.253278 Nov 15 12:47:46.857906 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 527/1081] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:46 2021] GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df => generated 1267 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:47.125574 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-37bc6814-18f3-4324-a727-84004a52461c tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:47.126191 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-37bc6814-18f3-4324-a727-84004a52461c tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 19636bbd-b763-4071-9f3f-5b6bd9f5d7a1] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:47.132738 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-37bc6814-18f3-4324-a727-84004a52461c tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:47.133433 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-37bc6814-18f3-4324-a727-84004a52461c tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:47.134248 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-37bc6814-18f3-4324-a727-84004a52461c tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:47.134874 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-37bc6814-18f3-4324-a727-84004a52461c tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:47.282699 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-37bc6814-18f3-4324-a727-84004a52461c tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:47.289685 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-37bc6814-18f3-4324-a727-84004a52461c tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1" status: 200 len: 1317 microversion: 2.1 time: 0.167914 Nov 15 12:47:47.290940 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 555/1082] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:47 2021] GET /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:47.873845 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-5b9f75c4-67c4-4072-9a48-9c19bfa69f19 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:47.874443 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-5b9f75c4-67c4-4072-9a48-9c19bfa69f19 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 012358cb-bdcf-4afc-b480-5399958e82df] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:47.880708 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5b9f75c4-67c4-4072-9a48-9c19bfa69f19 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:47.881150 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5b9f75c4-67c4-4072-9a48-9c19bfa69f19 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:47.881931 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5b9f75c4-67c4-4072-9a48-9c19bfa69f19 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:47.882358 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5b9f75c4-67c4-4072-9a48-9c19bfa69f19 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:48.025341 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-5b9f75c4-67c4-4072-9a48-9c19bfa69f19 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:48.034023 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-5b9f75c4-67c4-4072-9a48-9c19bfa69f19 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df" status: 200 len: 1267 microversion: 2.1 time: 0.164319 Nov 15 12:47:48.035151 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 528/1083] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:47 2021] GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:48.307999 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-3c8e66e7-9504-4155-b5c4-64408c1f3fed tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:48.310207 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-3c8e66e7-9504-4155-b5c4-64408c1f3fed tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 19636bbd-b763-4071-9f3f-5b6bd9f5d7a1] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:48.317654 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3c8e66e7-9504-4155-b5c4-64408c1f3fed tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:48.318456 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3c8e66e7-9504-4155-b5c4-64408c1f3fed tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:48.319524 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3c8e66e7-9504-4155-b5c4-64408c1f3fed tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:48.320253 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3c8e66e7-9504-4155-b5c4-64408c1f3fed tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:48.538519 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-3c8e66e7-9504-4155-b5c4-64408c1f3fed tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:48.547383 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-3c8e66e7-9504-4155-b5c4-64408c1f3fed tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1" status: 200 len: 1317 microversion: 2.1 time: 0.243523 Nov 15 12:47:48.548129 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 556/1084] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:48 2021] GET /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1 => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:49.051951 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-1faeae09-e406-49e3-a275-7af714a826ac tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:49.052512 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-1faeae09-e406-49e3-a275-7af714a826ac tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 012358cb-bdcf-4afc-b480-5399958e82df] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:49.059615 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1faeae09-e406-49e3-a275-7af714a826ac tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:49.060051 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1faeae09-e406-49e3-a275-7af714a826ac tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:49.060822 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1faeae09-e406-49e3-a275-7af714a826ac tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:49.061247 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1faeae09-e406-49e3-a275-7af714a826ac tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:49.241780 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-1faeae09-e406-49e3-a275-7af714a826ac tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:49.249657 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-1faeae09-e406-49e3-a275-7af714a826ac tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df" status: 200 len: 1267 microversion: 2.1 time: 0.201387 Nov 15 12:47:49.250238 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 529/1085] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:49 2021] GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df => generated 1267 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:49.564528 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-75b5e928-41a7-4146-9fa8-a1109405ee87 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:49.565366 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-75b5e928-41a7-4146-9fa8-a1109405ee87 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 19636bbd-b763-4071-9f3f-5b6bd9f5d7a1] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:49.576078 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-75b5e928-41a7-4146-9fa8-a1109405ee87 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:49.576479 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-75b5e928-41a7-4146-9fa8-a1109405ee87 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:49.577284 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-75b5e928-41a7-4146-9fa8-a1109405ee87 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:49.577774 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-75b5e928-41a7-4146-9fa8-a1109405ee87 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:49.719162 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-75b5e928-41a7-4146-9fa8-a1109405ee87 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:49.726944 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-75b5e928-41a7-4146-9fa8-a1109405ee87 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1" status: 200 len: 1317 microversion: 2.1 time: 0.166013 Nov 15 12:47:49.727525 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 557/1086] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:49 2021] GET /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:50.148320 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-f140302b-93b6-4052-8021-50dd4f86f346 req-349762e3-7fe1-49e4-a659-726efa4c75bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19636bbd-b763-4071-9f3f-5b6bd9f5d7a1", "name": "network-vif-plugged", "status": "completed", "tag": "dd7e7436-7fa2-46fb-a2c6-5d719d4dac18"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:47:50.150167 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:47:50.150167 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:47:50.158616 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-f140302b-93b6-4052-8021-50dd4f86f346 req-349762e3-7fe1-49e4-a659-726efa4c75bd service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:50.163532 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-f140302b-93b6-4052-8021-50dd4f86f346 req-349762e3-7fe1-49e4-a659-726efa4c75bd service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:50.172430 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-f140302b-93b6-4052-8021-50dd4f86f346 req-349762e3-7fe1-49e4-a659-726efa4c75bd service nova] Creating event network-vif-plugged:dd7e7436-7fa2-46fb-a2c6-5d719d4dac18 for instance 19636bbd-b763-4071-9f3f-5b6bd9f5d7a1 on hv-cinder-68088 Nov 15 12:47:50.177393 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-f140302b-93b6-4052-8021-50dd4f86f346 req-349762e3-7fe1-49e4-a659-726efa4c75bd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032551 Nov 15 12:47:50.178028 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 530/1087] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:47:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:47:50.267203 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-a69243c6-0c47-40ba-afdb-a2e4c8d36761 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:50.267827 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-a69243c6-0c47-40ba-afdb-a2e4c8d36761 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 012358cb-bdcf-4afc-b480-5399958e82df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:50.274060 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a69243c6-0c47-40ba-afdb-a2e4c8d36761 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:50.274511 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a69243c6-0c47-40ba-afdb-a2e4c8d36761 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:50.275333 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a69243c6-0c47-40ba-afdb-a2e4c8d36761 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:50.276646 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a69243c6-0c47-40ba-afdb-a2e4c8d36761 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:50.433423 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-a69243c6-0c47-40ba-afdb-a2e4c8d36761 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:50.440980 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-a69243c6-0c47-40ba-afdb-a2e4c8d36761 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df" status: 200 len: 1267 microversion: 2.1 time: 0.177654 Nov 15 12:47:50.441553 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 558/1088] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:50 2021] GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:50.744273 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-b00c8395-ee2f-4865-aaf6-74b84aa02b1c tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:50.746061 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-b00c8395-ee2f-4865-aaf6-74b84aa02b1c tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 19636bbd-b763-4071-9f3f-5b6bd9f5d7a1] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:50.752365 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b00c8395-ee2f-4865-aaf6-74b84aa02b1c tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:50.752808 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b00c8395-ee2f-4865-aaf6-74b84aa02b1c tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:50.753586 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b00c8395-ee2f-4865-aaf6-74b84aa02b1c tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:50.754020 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b00c8395-ee2f-4865-aaf6-74b84aa02b1c tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:50.902893 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-b00c8395-ee2f-4865-aaf6-74b84aa02b1c tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:50.910101 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-b00c8395-ee2f-4865-aaf6-74b84aa02b1c tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1" status: 200 len: 1317 microversion: 2.1 time: 0.169969 Nov 15 12:47:50.910671 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 531/1089] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:50 2021] GET /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:51.457280 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-b75b5c36-69d5-49c7-bf53-8997db705689 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:51.457924 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-b75b5c36-69d5-49c7-bf53-8997db705689 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 012358cb-bdcf-4afc-b480-5399958e82df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:51.465176 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b75b5c36-69d5-49c7-bf53-8997db705689 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:51.465625 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b75b5c36-69d5-49c7-bf53-8997db705689 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:51.466405 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b75b5c36-69d5-49c7-bf53-8997db705689 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:51.466872 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b75b5c36-69d5-49c7-bf53-8997db705689 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:51.607522 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-b75b5c36-69d5-49c7-bf53-8997db705689 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:51.614880 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-b75b5c36-69d5-49c7-bf53-8997db705689 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df" status: 200 len: 1267 microversion: 2.1 time: 0.161245 Nov 15 12:47:51.615459 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 559/1090] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:51 2021] GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:51.927959 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-1df67e60-fd25-448e-811b-d32345dd68c9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:51.928564 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-1df67e60-fd25-448e-811b-d32345dd68c9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 19636bbd-b763-4071-9f3f-5b6bd9f5d7a1] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:51.936149 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1df67e60-fd25-448e-811b-d32345dd68c9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:51.936605 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1df67e60-fd25-448e-811b-d32345dd68c9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:51.937442 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1df67e60-fd25-448e-811b-d32345dd68c9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:51.937912 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1df67e60-fd25-448e-811b-d32345dd68c9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:52.076504 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-1df67e60-fd25-448e-811b-d32345dd68c9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:52.084411 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-1df67e60-fd25-448e-811b-d32345dd68c9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1" status: 200 len: 1507 microversion: 2.1 time: 0.160361 Nov 15 12:47:52.084978 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 532/1091] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:51 2021] GET /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:52.632295 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-004e28b9-57a2-4545-9470-f8e2273887cb tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:52.632899 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-004e28b9-57a2-4545-9470-f8e2273887cb tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 012358cb-bdcf-4afc-b480-5399958e82df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:52.639695 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-004e28b9-57a2-4545-9470-f8e2273887cb tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:52.640130 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-004e28b9-57a2-4545-9470-f8e2273887cb tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:52.640888 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-004e28b9-57a2-4545-9470-f8e2273887cb tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:52.641311 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-004e28b9-57a2-4545-9470-f8e2273887cb tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:52.785493 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-004e28b9-57a2-4545-9470-f8e2273887cb tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:52.793264 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-004e28b9-57a2-4545-9470-f8e2273887cb tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df" status: 200 len: 1267 microversion: 2.1 time: 0.164569 Nov 15 12:47:52.794097 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 560/1092] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:52 2021] GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:53.433775 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-ef22843b-3f05-4fb4-8dc7-457ecde0ea13 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e4f965e-b03d-4c54-b4e4-215ec74878fb"}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:47:53.435440 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-ef22843b-3f05-4fb4-8dc7-457ecde0ea13 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 19636bbd-b763-4071-9f3f-5b6bd9f5d7a1] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:53.441915 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ef22843b-3f05-4fb4-8dc7-457ecde0ea13 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:53.442347 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ef22843b-3f05-4fb4-8dc7-457ecde0ea13 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:53.443137 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ef22843b-3f05-4fb4-8dc7-457ecde0ea13 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:53.443553 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ef22843b-3f05-4fb4-8dc7-457ecde0ea13 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:53.703632 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-ef22843b-3f05-4fb4-8dc7-457ecde0ea13 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "POST /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273995 Nov 15 12:47:53.704570 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 533/1093] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Nov 15 12:47:53 2021] POST /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:47:53.811541 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e621666f-b4b1-4b8e-9854-1d8e677b442a tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:53.812747 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e621666f-b4b1-4b8e-9854-1d8e677b442a tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 012358cb-bdcf-4afc-b480-5399958e82df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:53.819237 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e621666f-b4b1-4b8e-9854-1d8e677b442a tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:53.819770 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e621666f-b4b1-4b8e-9854-1d8e677b442a tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:53.820623 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e621666f-b4b1-4b8e-9854-1d8e677b442a tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:53.821133 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e621666f-b4b1-4b8e-9854-1d8e677b442a tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:54.024124 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e621666f-b4b1-4b8e-9854-1d8e677b442a tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:54.033280 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e621666f-b4b1-4b8e-9854-1d8e677b442a tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df" status: 200 len: 1267 microversion: 2.1 time: 0.226231 Nov 15 12:47:54.044554 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 561/1094] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:53 2021] GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df => generated 1267 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:55.051720 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-1572132c-5612-49b6-9105-22ca7fca7a49 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:55.052492 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-1572132c-5612-49b6-9105-22ca7fca7a49 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 012358cb-bdcf-4afc-b480-5399958e82df] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:55.058861 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1572132c-5612-49b6-9105-22ca7fca7a49 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:55.059383 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1572132c-5612-49b6-9105-22ca7fca7a49 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:55.060243 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1572132c-5612-49b6-9105-22ca7fca7a49 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:55.060758 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1572132c-5612-49b6-9105-22ca7fca7a49 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:55.203069 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-1572132c-5612-49b6-9105-22ca7fca7a49 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:55.210691 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-1572132c-5612-49b6-9105-22ca7fca7a49 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df" status: 200 len: 1267 microversion: 2.1 time: 0.163882 Nov 15 12:47:55.218030 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 534/1095] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:55 2021] GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:56.201504 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [req-65f78806-e60f-4428-9809-1cb51f3293ca req-d28e2fae-53db-45f6-97db-ada9f3edca8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "012358cb-bdcf-4afc-b480-5399958e82df", "name": "network-vif-plugged", "status": "completed", "tag": "471bc66e-1316-423a-b9d0-fa99991998d4"}]} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:47:56.204547 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:47:56.204547 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: warnings.warn(msg) Nov 15 12:47:56.212433 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-65f78806-e60f-4428-9809-1cb51f3293ca req-d28e2fae-53db-45f6-97db-ada9f3edca8a service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:56.212931 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-65f78806-e60f-4428-9809-1cb51f3293ca req-d28e2fae-53db-45f6-97db-ada9f3edca8a service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:56.228457 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-1bd91989-8758-45f0-bb41-8692008e28ea tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:56.229233 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.compute.server_external_events [req-65f78806-e60f-4428-9809-1cb51f3293ca req-d28e2fae-53db-45f6-97db-ada9f3edca8a service nova] Creating event network-vif-plugged:471bc66e-1316-423a-b9d0-fa99991998d4 for instance 012358cb-bdcf-4afc-b480-5399958e82df on hv-cinder-68088 Nov 15 12:47:56.229353 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-1bd91989-8758-45f0-bb41-8692008e28ea tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 012358cb-bdcf-4afc-b480-5399958e82df] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:56.234263 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [req-65f78806-e60f-4428-9809-1cb51f3293ca req-d28e2fae-53db-45f6-97db-ada9f3edca8a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038162 Nov 15 12:47:56.234919 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 562/1096] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:47:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:47:56.237238 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1bd91989-8758-45f0-bb41-8692008e28ea tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:56.237834 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1bd91989-8758-45f0-bb41-8692008e28ea tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:56.238930 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1bd91989-8758-45f0-bb41-8692008e28ea tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:56.239362 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-1bd91989-8758-45f0-bb41-8692008e28ea tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:56.383327 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-1bd91989-8758-45f0-bb41-8692008e28ea tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:56.391359 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-1bd91989-8758-45f0-bb41-8692008e28ea tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df" status: 200 len: 1267 microversion: 2.1 time: 0.167094 Nov 15 12:47:56.392013 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 535/1097] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:56 2021] GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:57.408734 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-4b4d9413-e150-4756-aa70-593f9fc2f058 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:57.409443 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-4b4d9413-e150-4756-aa70-593f9fc2f058 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 012358cb-bdcf-4afc-b480-5399958e82df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:57.415930 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4b4d9413-e150-4756-aa70-593f9fc2f058 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:57.417050 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4b4d9413-e150-4756-aa70-593f9fc2f058 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:57.418926 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4b4d9413-e150-4756-aa70-593f9fc2f058 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:57.419571 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-4b4d9413-e150-4756-aa70-593f9fc2f058 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:57.572203 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-4b4d9413-e150-4756-aa70-593f9fc2f058 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:57.580875 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-4b4d9413-e150-4756-aa70-593f9fc2f058 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df" status: 200 len: 1267 microversion: 2.1 time: 0.176660 Nov 15 12:47:57.581450 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 563/1098] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:57 2021] GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:58.598075 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-882b73c1-5bce-4bb4-aae6-84ff7eedeead tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:58.598754 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-882b73c1-5bce-4bb4-aae6-84ff7eedeead tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 012358cb-bdcf-4afc-b480-5399958e82df] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:58.606071 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-882b73c1-5bce-4bb4-aae6-84ff7eedeead tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:58.606520 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-882b73c1-5bce-4bb4-aae6-84ff7eedeead tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:58.607311 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-882b73c1-5bce-4bb4-aae6-84ff7eedeead tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:58.607739 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-882b73c1-5bce-4bb4-aae6-84ff7eedeead tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:58.749384 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-882b73c1-5bce-4bb4-aae6-84ff7eedeead tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:58.756952 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-882b73c1-5bce-4bb4-aae6-84ff7eedeead tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df" status: 200 len: 1455 microversion: 2.1 time: 0.162617 Nov 15 12:47:58.757531 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 536/1099] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:58 2021] GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df => generated 1455 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:47:58.773727 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-d3da7ce5-a99f-42d1-ad7c-12333937e711 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:47:58.774340 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-d3da7ce5-a99f-42d1-ad7c-12333937e711 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 012358cb-bdcf-4afc-b480-5399958e82df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:47:58.780964 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d3da7ce5-a99f-42d1-ad7c-12333937e711 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:58.781414 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d3da7ce5-a99f-42d1-ad7c-12333937e711 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:58.782193 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d3da7ce5-a99f-42d1-ad7c-12333937e711 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:47:58.782625 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-d3da7ce5-a99f-42d1-ad7c-12333937e711 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:47:58.922558 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-d3da7ce5-a99f-42d1-ad7c-12333937e711 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:47:58.930474 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-d3da7ce5-a99f-42d1-ad7c-12333937e711 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df" status: 200 len: 1455 microversion: 2.1 time: 0.160298 Nov 15 12:47:58.931127 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 564/1100] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:47:58 2021] GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df => generated 1455 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:48:00.642086 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-f74023a5-617c-4ed5-bffd-ea82b3a64f86 req-6da8d6c3-c02e-46df-b13c-ac35d65c8dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "012358cb-bdcf-4afc-b480-5399958e82df", "tag": "471bc66e-1316-423a-b9d0-fa99991998d4"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:48:00.643679 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:48:00.643679 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:48:00.651236 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-f74023a5-617c-4ed5-bffd-ea82b3a64f86 req-6da8d6c3-c02e-46df-b13c-ac35d65c8dc2 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:00.651672 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-f74023a5-617c-4ed5-bffd-ea82b3a64f86 req-6da8d6c3-c02e-46df-b13c-ac35d65c8dc2 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:00.662255 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-f74023a5-617c-4ed5-bffd-ea82b3a64f86 req-6da8d6c3-c02e-46df-b13c-ac35d65c8dc2 service nova] Creating event network-changed:471bc66e-1316-423a-b9d0-fa99991998d4 for instance 012358cb-bdcf-4afc-b480-5399958e82df on hv-cinder-68088 Nov 15 12:48:00.667726 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-f74023a5-617c-4ed5-bffd-ea82b3a64f86 req-6da8d6c3-c02e-46df-b13c-ac35d65c8dc2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028977 Nov 15 12:48:00.668315 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 537/1101] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:48:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:48:01.359851 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-7737940d-c59c-4858-8b32-3b8dff542fe9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:48:01.360578 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-7737940d-c59c-4858-8b32-3b8dff542fe9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 19636bbd-b763-4071-9f3f-5b6bd9f5d7a1] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:48:01.367132 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7737940d-c59c-4858-8b32-3b8dff542fe9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:01.367809 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7737940d-c59c-4858-8b32-3b8dff542fe9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:01.368774 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7737940d-c59c-4858-8b32-3b8dff542fe9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:01.369250 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7737940d-c59c-4858-8b32-3b8dff542fe9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:01.464759 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.objects.instance [None req-7737940d-c59c-4858-8b32-3b8dff542fe9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lazy-loading 'services' on Instance uuid 19636bbd-b763-4071-9f3f-5b6bd9f5d7a1 {{(pid=122567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 15 12:48:01.547873 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-7737940d-c59c-4858-8b32-3b8dff542fe9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "DELETE /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1/os-volume_attachments/0e4f965e-b03d-4c54-b4e4-215ec74878fb" status: 202 len: 0 microversion: 2.1 time: 0.191810 Nov 15 12:48:01.548554 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 565/1102] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Nov 15 12:48:01 2021] DELETE /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1/os-volume_attachments/0e4f965e-b03d-4c54-b4e4-215ec74878fb => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:48:01.558506 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-814752a2-1641-4dc5-ac59-6910f1501543 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:48:01.559695 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-814752a2-1641-4dc5-ac59-6910f1501543 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 19636bbd-b763-4071-9f3f-5b6bd9f5d7a1] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:48:01.566268 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-814752a2-1641-4dc5-ac59-6910f1501543 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:01.566715 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-814752a2-1641-4dc5-ac59-6910f1501543 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:01.567525 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-814752a2-1641-4dc5-ac59-6910f1501543 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:01.567997 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-814752a2-1641-4dc5-ac59-6910f1501543 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:01.602543 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-814752a2-1641-4dc5-ac59-6910f1501543 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049189 Nov 15 12:48:01.603120 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 538/1103] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Nov 15 12:48:01 2021] GET /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 15 12:48:02.616337 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-28e3684e-54f8-4b7e-a2d1-a67aad29aa3d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:48:02.617449 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-28e3684e-54f8-4b7e-a2d1-a67aad29aa3d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 19636bbd-b763-4071-9f3f-5b6bd9f5d7a1] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:48:02.623728 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-28e3684e-54f8-4b7e-a2d1-a67aad29aa3d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:02.624180 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-28e3684e-54f8-4b7e-a2d1-a67aad29aa3d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:02.624964 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-28e3684e-54f8-4b7e-a2d1-a67aad29aa3d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:02.625398 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-28e3684e-54f8-4b7e-a2d1-a67aad29aa3d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:02.655540 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-28e3684e-54f8-4b7e-a2d1-a67aad29aa3d tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044051 Nov 15 12:48:02.656120 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 566/1104] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Nov 15 12:48:02 2021] GET /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:48:03.667837 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-67ad71bc-bada-47f3-8577-3f37ca61979e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:48:03.668999 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-67ad71bc-bada-47f3-8577-3f37ca61979e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 19636bbd-b763-4071-9f3f-5b6bd9f5d7a1] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:48:03.675449 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-67ad71bc-bada-47f3-8577-3f37ca61979e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:03.675788 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-67ad71bc-bada-47f3-8577-3f37ca61979e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:03.676569 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-67ad71bc-bada-47f3-8577-3f37ca61979e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:03.676999 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-67ad71bc-bada-47f3-8577-3f37ca61979e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:03.707796 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-67ad71bc-bada-47f3-8577-3f37ca61979e tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044659 Nov 15 12:48:03.708368 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 539/1105] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Nov 15 12:48:03 2021] GET /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 15 12:48:04.891569 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-cbe08ea5-b5fc-4739-92ba-476ddba1d669 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:48:04.892044 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-cbe08ea5-b5fc-4739-92ba-476ddba1d669 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 19636bbd-b763-4071-9f3f-5b6bd9f5d7a1] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:48:04.898254 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cbe08ea5-b5fc-4739-92ba-476ddba1d669 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:04.898691 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cbe08ea5-b5fc-4739-92ba-476ddba1d669 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:04.899485 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cbe08ea5-b5fc-4739-92ba-476ddba1d669 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:04.899931 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-cbe08ea5-b5fc-4739-92ba-476ddba1d669 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:04.924857 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-cbe08ea5-b5fc-4739-92ba-476ddba1d669 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 19636bbd-b763-4071-9f3f-5b6bd9f5d7a1] Going to try to terminate instance {{(pid=122567) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 15 12:48:05.000572 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-cbe08ea5-b5fc-4739-92ba-476ddba1d669 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "DELETE /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1" status: 204 len: 0 microversion: 2.1 time: 0.112293 Nov 15 12:48:05.001162 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 567/1106] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Nov 15 12:48:04 2021] DELETE /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 15 12:48:05.009386 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-b6a0dcb6-0f59-42ab-8a75-c5819d00bb96 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:48:05.011497 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-b6a0dcb6-0f59-42ab-8a75-c5819d00bb96 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 19636bbd-b763-4071-9f3f-5b6bd9f5d7a1] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:48:05.017260 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b6a0dcb6-0f59-42ab-8a75-c5819d00bb96 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:05.017707 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b6a0dcb6-0f59-42ab-8a75-c5819d00bb96 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:05.018484 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b6a0dcb6-0f59-42ab-8a75-c5819d00bb96 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:05.018948 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b6a0dcb6-0f59-42ab-8a75-c5819d00bb96 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:05.148983 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-b6a0dcb6-0f59-42ab-8a75-c5819d00bb96 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:48:05.156415 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-b6a0dcb6-0f59-42ab-8a75-c5819d00bb96 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1" status: 200 len: 1513 microversion: 2.1 time: 0.151099 Nov 15 12:48:05.156976 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 540/1107] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:48:05 2021] GET /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:48:06.174850 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-388c76d5-eacd-4516-8d13-4c29ce2a08fb tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:48:06.175641 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-388c76d5-eacd-4516-8d13-4c29ce2a08fb tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 19636bbd-b763-4071-9f3f-5b6bd9f5d7a1] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:48:06.182705 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-388c76d5-eacd-4516-8d13-4c29ce2a08fb tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:06.183463 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-388c76d5-eacd-4516-8d13-4c29ce2a08fb tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:06.184146 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-388c76d5-eacd-4516-8d13-4c29ce2a08fb tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:06.184594 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-388c76d5-eacd-4516-8d13-4c29ce2a08fb tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:06.321333 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-388c76d5-eacd-4516-8d13-4c29ce2a08fb tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:48:06.333565 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-388c76d5-eacd-4516-8d13-4c29ce2a08fb tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1" status: 200 len: 1513 microversion: 2.1 time: 0.163315 Nov 15 12:48:06.334151 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 568/1108] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:48:06 2021] GET /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:48:07.355827 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-bb4cac82-a79b-4e58-820d-37be4f6b33bd tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:48:07.356994 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-bb4cac82-a79b-4e58-820d-37be4f6b33bd tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 19636bbd-b763-4071-9f3f-5b6bd9f5d7a1] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:48:07.367485 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bb4cac82-a79b-4e58-820d-37be4f6b33bd tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:07.368269 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bb4cac82-a79b-4e58-820d-37be4f6b33bd tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:07.369957 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bb4cac82-a79b-4e58-820d-37be4f6b33bd tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:07.370682 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-bb4cac82-a79b-4e58-820d-37be4f6b33bd tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:07.559036 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-bb4cac82-a79b-4e58-820d-37be4f6b33bd tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:48:07.572479 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-bb4cac82-a79b-4e58-820d-37be4f6b33bd tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1" status: 200 len: 1513 microversion: 2.1 time: 0.223840 Nov 15 12:48:07.573745 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 541/1109] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:48:07 2021] GET /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1 => generated 1513 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:48:07.601236 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [req-a3eb476e-44a7-4b6c-a06e-aa31355118f9 req-9e5d81d2-f0b3-4924-bc43-eaae69d12b0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19636bbd-b763-4071-9f3f-5b6bd9f5d7a1", "name": "network-vif-deleted", "tag": "dd7e7436-7fa2-46fb-a2c6-5d719d4dac18"}]} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:48:07.602756 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:48:07.602756 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: warnings.warn(msg) Nov 15 12:48:07.614721 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-a3eb476e-44a7-4b6c-a06e-aa31355118f9 req-9e5d81d2-f0b3-4924-bc43-eaae69d12b0b service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:07.615521 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-a3eb476e-44a7-4b6c-a06e-aa31355118f9 req-9e5d81d2-f0b3-4924-bc43-eaae69d12b0b service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:07.627546 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.compute.server_external_events [req-a3eb476e-44a7-4b6c-a06e-aa31355118f9 req-9e5d81d2-f0b3-4924-bc43-eaae69d12b0b service nova] Creating event network-vif-deleted:dd7e7436-7fa2-46fb-a2c6-5d719d4dac18 for instance 19636bbd-b763-4071-9f3f-5b6bd9f5d7a1 on hv-cinder-68088 Nov 15 12:48:07.633784 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [req-a3eb476e-44a7-4b6c-a06e-aa31355118f9 req-9e5d81d2-f0b3-4924-bc43-eaae69d12b0b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036092 Nov 15 12:48:07.634519 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 569/1110] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:48:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:48:08.590810 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-82339c67-65af-4fbb-8ad8-1e5ae76f2873 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:48:08.591373 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-82339c67-65af-4fbb-8ad8-1e5ae76f2873 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 19636bbd-b763-4071-9f3f-5b6bd9f5d7a1] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:48:08.597774 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-82339c67-65af-4fbb-8ad8-1e5ae76f2873 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:08.598386 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-82339c67-65af-4fbb-8ad8-1e5ae76f2873 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:08.599573 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-82339c67-65af-4fbb-8ad8-1e5ae76f2873 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:08.599998 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-82339c67-65af-4fbb-8ad8-1e5ae76f2873 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:08.614288 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.wsgi [None req-82339c67-65af-4fbb-8ad8-1e5ae76f2873 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] HTTP exception thrown: Instance 19636bbd-b763-4071-9f3f-5b6bd9f5d7a1 could not be found. Nov 15 12:48:08.615021 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-82339c67-65af-4fbb-8ad8-1e5ae76f2873 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Returning 404 to user: Instance 19636bbd-b763-4071-9f3f-5b6bd9f5d7a1 could not be found. {{(pid=122568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:48:08.615909 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-82339c67-65af-4fbb-8ad8-1e5ae76f2873 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1" status: 404 len: 111 microversion: 2.1 time: 0.029699 Nov 15 12:48:08.616453 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 542/1111] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:48:08 2021] GET /compute/v2.1/servers/19636bbd-b763-4071-9f3f-5b6bd9f5d7a1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 15 12:48:09.753291 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-ecd458d1-a739-4e3a-b579-4a00ec9b0ad9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:48:09.753876 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-ecd458d1-a739-4e3a-b579-4a00ec9b0ad9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 7abe3987-72d1-4833-86a4-001443048c51] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:48:09.765480 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ecd458d1-a739-4e3a-b579-4a00ec9b0ad9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:09.766026 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ecd458d1-a739-4e3a-b579-4a00ec9b0ad9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:09.766803 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ecd458d1-a739-4e3a-b579-4a00ec9b0ad9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:09.767276 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ecd458d1-a739-4e3a-b579-4a00ec9b0ad9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:09.794064 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-ecd458d1-a739-4e3a-b579-4a00ec9b0ad9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 7abe3987-72d1-4833-86a4-001443048c51] Going to try to terminate instance {{(pid=122567) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 15 12:48:09.877862 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-ecd458d1-a739-4e3a-b579-4a00ec9b0ad9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51" status: 204 len: 0 microversion: 2.1 time: 0.128723 Nov 15 12:48:09.878392 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 570/1112] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Nov 15 12:48:09 2021] DELETE /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 15 12:48:09.887144 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-efca8dea-b30f-4c63-8e31-8b82bb958ff9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:48:09.887757 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-efca8dea-b30f-4c63-8e31-8b82bb958ff9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 7abe3987-72d1-4833-86a4-001443048c51] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:48:09.895985 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-efca8dea-b30f-4c63-8e31-8b82bb958ff9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:09.896419 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-efca8dea-b30f-4c63-8e31-8b82bb958ff9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:09.897209 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-efca8dea-b30f-4c63-8e31-8b82bb958ff9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:09.897671 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-efca8dea-b30f-4c63-8e31-8b82bb958ff9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:10.034817 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-efca8dea-b30f-4c63-8e31-8b82bb958ff9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:48:10.042993 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-efca8dea-b30f-4c63-8e31-8b82bb958ff9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51" status: 200 len: 1514 microversion: 2.1 time: 0.160069 Nov 15 12:48:10.043800 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 543/1113] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:48:09 2021] GET /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:48:11.061208 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-9c683ba3-b45b-48b4-9b39-f4c2223d21c1 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:48:11.061902 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-9c683ba3-b45b-48b4-9b39-f4c2223d21c1 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 7abe3987-72d1-4833-86a4-001443048c51] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:48:11.068252 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9c683ba3-b45b-48b4-9b39-f4c2223d21c1 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:11.068717 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9c683ba3-b45b-48b4-9b39-f4c2223d21c1 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:11.069534 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9c683ba3-b45b-48b4-9b39-f4c2223d21c1 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:11.069977 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9c683ba3-b45b-48b4-9b39-f4c2223d21c1 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:11.202380 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-9c683ba3-b45b-48b4-9b39-f4c2223d21c1 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:48:11.209898 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-9c683ba3-b45b-48b4-9b39-f4c2223d21c1 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51" status: 200 len: 1514 microversion: 2.1 time: 0.153317 Nov 15 12:48:11.210470 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 571/1114] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:48:11 2021] GET /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:48:12.229419 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-ba4caa69-8bf9-4bf1-847d-3cf42d85c36f tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:48:12.231841 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-ba4caa69-8bf9-4bf1-847d-3cf42d85c36f tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 7abe3987-72d1-4833-86a4-001443048c51] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:48:12.241480 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ba4caa69-8bf9-4bf1-847d-3cf42d85c36f tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:12.242164 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ba4caa69-8bf9-4bf1-847d-3cf42d85c36f tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:12.245243 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ba4caa69-8bf9-4bf1-847d-3cf42d85c36f tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:12.251226 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [req-44b96aa6-06d0-4fb6-8fad-78205e9370b4 req-9c88cd4c-efee-439b-a9da-acc4a6ab7bdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7abe3987-72d1-4833-86a4-001443048c51", "name": "network-vif-deleted", "tag": "a322e5bf-88e1-4927-ae82-1bdc781c9029"}]} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:48:12.252807 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:48:12.252807 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: warnings.warn(msg) Nov 15 12:48:12.256548 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ba4caa69-8bf9-4bf1-847d-3cf42d85c36f tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:12.271002 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-44b96aa6-06d0-4fb6-8fad-78205e9370b4 req-9c88cd4c-efee-439b-a9da-acc4a6ab7bdf service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:12.271753 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-44b96aa6-06d0-4fb6-8fad-78205e9370b4 req-9c88cd4c-efee-439b-a9da-acc4a6ab7bdf service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:12.294152 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.compute.server_external_events [req-44b96aa6-06d0-4fb6-8fad-78205e9370b4 req-9c88cd4c-efee-439b-a9da-acc4a6ab7bdf service nova] Creating event network-vif-deleted:a322e5bf-88e1-4927-ae82-1bdc781c9029 for instance 7abe3987-72d1-4833-86a4-001443048c51 on hv-cinder-68088 Nov 15 12:48:12.316444 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [req-44b96aa6-06d0-4fb6-8fad-78205e9370b4 req-9c88cd4c-efee-439b-a9da-acc4a6ab7bdf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069160 Nov 15 12:48:12.317800 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 572/1115] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:48:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 15 12:48:12.354940 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-ba4caa69-8bf9-4bf1-847d-3cf42d85c36f tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:48:12.368654 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-ba4caa69-8bf9-4bf1-847d-3cf42d85c36f tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51" status: 200 len: 1472 microversion: 2.1 time: 0.144943 Nov 15 12:48:12.371180 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 544/1116] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:48:12 2021] GET /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51 => generated 1472 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:48:13.387474 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-9af40de4-5fce-4f0d-befa-ee4f01b1fa38 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:48:13.388697 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-9af40de4-5fce-4f0d-befa-ee4f01b1fa38 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: 7abe3987-72d1-4833-86a4-001443048c51] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:48:13.394872 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9af40de4-5fce-4f0d-befa-ee4f01b1fa38 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:13.395259 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9af40de4-5fce-4f0d-befa-ee4f01b1fa38 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:13.396047 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9af40de4-5fce-4f0d-befa-ee4f01b1fa38 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:13.396483 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9af40de4-5fce-4f0d-befa-ee4f01b1fa38 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:13.409711 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.wsgi [None req-9af40de4-5fce-4f0d-befa-ee4f01b1fa38 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] HTTP exception thrown: Instance 7abe3987-72d1-4833-86a4-001443048c51 could not be found. Nov 15 12:48:13.410304 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-9af40de4-5fce-4f0d-befa-ee4f01b1fa38 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Returning 404 to user: Instance 7abe3987-72d1-4833-86a4-001443048c51 could not be found. {{(pid=122567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:48:13.411178 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-9af40de4-5fce-4f0d-befa-ee4f01b1fa38 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51" status: 404 len: 111 microversion: 2.1 time: 0.027746 Nov 15 12:48:13.411721 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 573/1117] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:48:13 2021] GET /compute/v2.1/servers/7abe3987-72d1-4833-86a4-001443048c51 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 15 12:48:13.421017 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-7d27e9b3-c0fd-4b0f-9b15-a566fe6ad084 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:48:13.421538 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-7d27e9b3-c0fd-4b0f-9b15-a566fe6ad084 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: bca45233-33d6-4c53-a043-8c482833c962] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:48:13.427757 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7d27e9b3-c0fd-4b0f-9b15-a566fe6ad084 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:13.428194 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7d27e9b3-c0fd-4b0f-9b15-a566fe6ad084 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:13.428951 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7d27e9b3-c0fd-4b0f-9b15-a566fe6ad084 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:13.429382 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7d27e9b3-c0fd-4b0f-9b15-a566fe6ad084 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:13.455187 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-7d27e9b3-c0fd-4b0f-9b15-a566fe6ad084 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: bca45233-33d6-4c53-a043-8c482833c962] Going to try to terminate instance {{(pid=122568) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 15 12:48:13.537377 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-7d27e9b3-c0fd-4b0f-9b15-a566fe6ad084 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "DELETE /compute/v2.1/servers/bca45233-33d6-4c53-a043-8c482833c962" status: 204 len: 0 microversion: 2.1 time: 0.119762 Nov 15 12:48:13.539392 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 545/1118] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Nov 15 12:48:13 2021] DELETE /compute/v2.1/servers/bca45233-33d6-4c53-a043-8c482833c962 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 15 12:48:13.549595 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-a31d5ca5-b5d3-4510-8cf7-3ab03d301801 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:48:13.550295 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-a31d5ca5-b5d3-4510-8cf7-3ab03d301801 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: bca45233-33d6-4c53-a043-8c482833c962] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:48:13.558498 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a31d5ca5-b5d3-4510-8cf7-3ab03d301801 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:13.559204 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a31d5ca5-b5d3-4510-8cf7-3ab03d301801 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:13.560557 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a31d5ca5-b5d3-4510-8cf7-3ab03d301801 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:13.560682 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a31d5ca5-b5d3-4510-8cf7-3ab03d301801 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:13.699379 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-a31d5ca5-b5d3-4510-8cf7-3ab03d301801 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:48:13.707411 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-a31d5ca5-b5d3-4510-8cf7-3ab03d301801 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/bca45233-33d6-4c53-a043-8c482833c962" status: 200 len: 1514 microversion: 2.1 time: 0.161295 Nov 15 12:48:13.707902 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 574/1119] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:48:13 2021] GET /compute/v2.1/servers/bca45233-33d6-4c53-a043-8c482833c962 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:48:14.725944 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-960fa85d-d13e-4f35-9f68-48a5ea4fa434 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:48:14.726629 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-960fa85d-d13e-4f35-9f68-48a5ea4fa434 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: bca45233-33d6-4c53-a043-8c482833c962] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:48:14.733200 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-960fa85d-d13e-4f35-9f68-48a5ea4fa434 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:14.733637 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-960fa85d-d13e-4f35-9f68-48a5ea4fa434 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:14.734401 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-960fa85d-d13e-4f35-9f68-48a5ea4fa434 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:14.734876 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-960fa85d-d13e-4f35-9f68-48a5ea4fa434 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:14.867209 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-960fa85d-d13e-4f35-9f68-48a5ea4fa434 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:48:14.876766 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-960fa85d-d13e-4f35-9f68-48a5ea4fa434 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/bca45233-33d6-4c53-a043-8c482833c962" status: 200 len: 1514 microversion: 2.1 time: 0.154467 Nov 15 12:48:14.877345 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 546/1120] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:48:14 2021] GET /compute/v2.1/servers/bca45233-33d6-4c53-a043-8c482833c962 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:48:15.632742 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [req-2bd6c96c-f88f-4155-b9b5-ea561971cd4a req-1c320d31-a788-4999-b08b-4be2b4784774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bca45233-33d6-4c53-a043-8c482833c962", "name": "network-vif-deleted", "tag": "e472414f-49b1-4318-a5a8-147ad466ee3d"}]} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:48:15.634603 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:48:15.634603 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: warnings.warn(msg) Nov 15 12:48:15.644152 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-2bd6c96c-f88f-4155-b9b5-ea561971cd4a req-1c320d31-a788-4999-b08b-4be2b4784774 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:15.644593 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-2bd6c96c-f88f-4155-b9b5-ea561971cd4a req-1c320d31-a788-4999-b08b-4be2b4784774 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:15.658009 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.compute.server_external_events [req-2bd6c96c-f88f-4155-b9b5-ea561971cd4a req-1c320d31-a788-4999-b08b-4be2b4784774 service nova] Creating event network-vif-deleted:e472414f-49b1-4318-a5a8-147ad466ee3d for instance bca45233-33d6-4c53-a043-8c482833c962 on hv-cinder-68088 Nov 15 12:48:15.664341 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [req-2bd6c96c-f88f-4155-b9b5-ea561971cd4a req-1c320d31-a788-4999-b08b-4be2b4784774 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035260 Nov 15 12:48:15.664951 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 575/1121] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:48:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:48:15.894354 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-856cede0-207a-4754-9d61-7653e63e74da tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:48:15.894951 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-856cede0-207a-4754-9d61-7653e63e74da tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: bca45233-33d6-4c53-a043-8c482833c962] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:48:15.901475 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-856cede0-207a-4754-9d61-7653e63e74da tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:15.901916 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-856cede0-207a-4754-9d61-7653e63e74da tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:15.902742 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-856cede0-207a-4754-9d61-7653e63e74da tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:15.903231 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-856cede0-207a-4754-9d61-7653e63e74da tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:15.935808 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-856cede0-207a-4754-9d61-7653e63e74da tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:15.936331 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-856cede0-207a-4754-9d61-7653e63e74da tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:15.936797 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.objects.instance [None req-856cede0-207a-4754-9d61-7653e63e74da tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lazy-loading 'fault' on Instance uuid bca45233-33d6-4c53-a043-8c482833c962 {{(pid=122568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 15 12:48:15.975029 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-856cede0-207a-4754-9d61-7653e63e74da tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:48:15.983154 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-856cede0-207a-4754-9d61-7653e63e74da tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/bca45233-33d6-4c53-a043-8c482833c962" status: 200 len: 1308 microversion: 2.1 time: 0.092509 Nov 15 12:48:15.983720 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 547/1122] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:48:15 2021] GET /compute/v2.1/servers/bca45233-33d6-4c53-a043-8c482833c962 => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:48:17.000705 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-6f61faf7-f678-4708-892e-1842185eca52 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:48:17.001400 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-6f61faf7-f678-4708-892e-1842185eca52 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: bca45233-33d6-4c53-a043-8c482833c962] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:48:17.007953 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6f61faf7-f678-4708-892e-1842185eca52 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:17.008401 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6f61faf7-f678-4708-892e-1842185eca52 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:17.009174 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6f61faf7-f678-4708-892e-1842185eca52 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:17.010558 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6f61faf7-f678-4708-892e-1842185eca52 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:17.023078 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.wsgi [None req-6f61faf7-f678-4708-892e-1842185eca52 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] HTTP exception thrown: Instance bca45233-33d6-4c53-a043-8c482833c962 could not be found. Nov 15 12:48:17.023666 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-6f61faf7-f678-4708-892e-1842185eca52 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Returning 404 to user: Instance bca45233-33d6-4c53-a043-8c482833c962 could not be found. {{(pid=122567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:48:17.024503 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-6f61faf7-f678-4708-892e-1842185eca52 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/bca45233-33d6-4c53-a043-8c482833c962" status: 404 len: 111 microversion: 2.1 time: 0.027853 Nov 15 12:48:17.025035 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 576/1123] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:48:16 2021] GET /compute/v2.1/servers/bca45233-33d6-4c53-a043-8c482833c962 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 15 12:48:18.153195 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-3e234fdd-70ff-43b4-8f0f-659ad196a8f9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:48:18.153716 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-3e234fdd-70ff-43b4-8f0f-659ad196a8f9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: fb106071-4d21-44c8-b21d-653a55a214ca] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:48:18.159941 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3e234fdd-70ff-43b4-8f0f-659ad196a8f9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:18.160383 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3e234fdd-70ff-43b4-8f0f-659ad196a8f9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:18.161165 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3e234fdd-70ff-43b4-8f0f-659ad196a8f9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:18.161600 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3e234fdd-70ff-43b4-8f0f-659ad196a8f9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:18.188517 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-3e234fdd-70ff-43b4-8f0f-659ad196a8f9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: fb106071-4d21-44c8-b21d-653a55a214ca] Going to try to terminate instance {{(pid=122568) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 15 12:48:18.263455 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-3e234fdd-70ff-43b4-8f0f-659ad196a8f9 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca" status: 204 len: 0 microversion: 2.1 time: 0.114203 Nov 15 12:48:18.264087 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 548/1124] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Nov 15 12:48:18 2021] DELETE /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 15 12:48:18.272019 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-1a67535e-73a2-4074-9926-bd3e6ea36fb1 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:48:18.272657 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-1a67535e-73a2-4074-9926-bd3e6ea36fb1 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: fb106071-4d21-44c8-b21d-653a55a214ca] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:48:18.279774 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1a67535e-73a2-4074-9926-bd3e6ea36fb1 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:18.280222 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1a67535e-73a2-4074-9926-bd3e6ea36fb1 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:18.280991 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1a67535e-73a2-4074-9926-bd3e6ea36fb1 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:18.281417 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1a67535e-73a2-4074-9926-bd3e6ea36fb1 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:18.417464 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-1a67535e-73a2-4074-9926-bd3e6ea36fb1 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:48:18.425887 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-1a67535e-73a2-4074-9926-bd3e6ea36fb1 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca" status: 200 len: 1514 microversion: 2.1 time: 0.156875 Nov 15 12:48:18.426657 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 577/1125] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:48:18 2021] GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:48:19.449446 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-7234a63d-cadb-4d6f-a309-ff54e42fc482 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:48:19.450078 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-7234a63d-cadb-4d6f-a309-ff54e42fc482 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: fb106071-4d21-44c8-b21d-653a55a214ca] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:48:19.456455 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7234a63d-cadb-4d6f-a309-ff54e42fc482 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:19.456892 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7234a63d-cadb-4d6f-a309-ff54e42fc482 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:19.457680 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7234a63d-cadb-4d6f-a309-ff54e42fc482 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:19.458107 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-7234a63d-cadb-4d6f-a309-ff54e42fc482 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:19.599140 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-7234a63d-cadb-4d6f-a309-ff54e42fc482 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:48:19.607305 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-7234a63d-cadb-4d6f-a309-ff54e42fc482 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca" status: 200 len: 1514 microversion: 2.1 time: 0.162740 Nov 15 12:48:19.607976 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 549/1126] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:48:19 2021] GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:48:20.601160 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [req-83ef6b5e-27c2-4bfe-8384-cf0bc1e2e021 req-df5993d3-ec2d-44fa-b68d-6b4869a28bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb106071-4d21-44c8-b21d-653a55a214ca", "name": "network-vif-deleted", "tag": "cdda0c80-f41d-4d26-b88b-3cf602da9cca"}]} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:48:20.602674 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:48:20.602674 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: warnings.warn(msg) Nov 15 12:48:20.611189 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-83ef6b5e-27c2-4bfe-8384-cf0bc1e2e021 req-df5993d3-ec2d-44fa-b68d-6b4869a28bfd service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:20.611634 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-83ef6b5e-27c2-4bfe-8384-cf0bc1e2e021 req-df5993d3-ec2d-44fa-b68d-6b4869a28bfd service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:20.624968 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-b01f54b3-5a53-4674-a992-e741228a6920 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:48:20.625915 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-b01f54b3-5a53-4674-a992-e741228a6920 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: fb106071-4d21-44c8-b21d-653a55a214ca] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:48:20.627993 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.compute.server_external_events [req-83ef6b5e-27c2-4bfe-8384-cf0bc1e2e021 req-df5993d3-ec2d-44fa-b68d-6b4869a28bfd service nova] Creating event network-vif-deleted:cdda0c80-f41d-4d26-b88b-3cf602da9cca for instance fb106071-4d21-44c8-b21d-653a55a214ca on hv-cinder-68088 Nov 15 12:48:20.633893 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [req-83ef6b5e-27c2-4bfe-8384-cf0bc1e2e021 req-df5993d3-ec2d-44fa-b68d-6b4869a28bfd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036389 Nov 15 12:48:20.634343 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b01f54b3-5a53-4674-a992-e741228a6920 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:20.634808 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b01f54b3-5a53-4674-a992-e741228a6920 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:20.635092 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 578/1127] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:48:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:48:20.635592 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b01f54b3-5a53-4674-a992-e741228a6920 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:20.636015 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b01f54b3-5a53-4674-a992-e741228a6920 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:20.716150 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-b01f54b3-5a53-4674-a992-e741228a6920 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6612e1905c4e70b39aaa552b9de730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b023f637e184e67bccf0ed11a6a802d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:48:20.724683 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-b01f54b3-5a53-4674-a992-e741228a6920 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca" status: 200 len: 1303 microversion: 2.1 time: 0.103684 Nov 15 12:48:20.725809 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 550/1128] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:48:20 2021] GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:48:21.743460 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-79e9d964-3883-4366-ab3a-6e649b132ca6 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:48:21.744510 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-79e9d964-3883-4366-ab3a-6e649b132ca6 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] [instance: fb106071-4d21-44c8-b21d-653a55a214ca] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:48:21.753561 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-79e9d964-3883-4366-ab3a-6e649b132ca6 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:21.754248 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-79e9d964-3883-4366-ab3a-6e649b132ca6 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:21.755471 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-79e9d964-3883-4366-ab3a-6e649b132ca6 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:21.756131 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-79e9d964-3883-4366-ab3a-6e649b132ca6 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:21.773552 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.wsgi [None req-79e9d964-3883-4366-ab3a-6e649b132ca6 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] HTTP exception thrown: Instance fb106071-4d21-44c8-b21d-653a55a214ca could not be found. Nov 15 12:48:21.774156 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-79e9d964-3883-4366-ab3a-6e649b132ca6 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] Returning 404 to user: Instance fb106071-4d21-44c8-b21d-653a55a214ca could not be found. {{(pid=122567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:48:21.775673 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-79e9d964-3883-4366-ab3a-6e649b132ca6 tempest-AttachVolumeNegativeTest-1265613092 tempest-AttachVolumeNegativeTest-1265613092-project] 10.222.0.43 "GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca" status: 404 len: 111 microversion: 2.1 time: 0.036205 Nov 15 12:48:21.776454 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 579/1129] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:48:21 2021] GET /compute/v2.1/servers/fb106071-4d21-44c8-b21d-653a55a214ca => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 15 12:48:23.752996 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-7c7632f6-e8e4-4b3f-9207-b79468fa5976 tempest-VolumesNegativeTest-920873260 tempest-VolumesNegativeTest-920873260-project] Action: 'create', calling method: .version_select at 0x7f131b1ec5e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1963418438", "metadata": {"Type": "work"}}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:48:23.754324 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-7c7632f6-e8e4-4b3f-9207-b79468fa5976 tempest-VolumesNegativeTest-920873260 tempest-VolumesNegativeTest-920873260-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:48:23.755137 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-7c7632f6-e8e4-4b3f-9207-b79468fa5976 tempest-VolumesNegativeTest-920873260 tempest-VolumesNegativeTest-920873260-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.111870 Nov 15 12:48:23.755650 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 551/1130] 10.222.0.43 () {60 vars in 1155 bytes} [Mon Nov 15 12:48:23 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 15 12:48:23.765288 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-6e8f1d0e-fdec-4e5b-97b3-9a52dd5bc5b8 tempest-VolumesNegativeTest-920873260 tempest-VolumesNegativeTest-920873260-project] Action: 'create', calling method: .version_select at 0x7f132038a0d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1554490380", "metadata": {"Type": "work"}}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:48:23.766683 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-6e8f1d0e-fdec-4e5b-97b3-9a52dd5bc5b8 tempest-VolumesNegativeTest-920873260 tempest-VolumesNegativeTest-920873260-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:48:23.767516 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-6e8f1d0e-fdec-4e5b-97b3-9a52dd5bc5b8 tempest-VolumesNegativeTest-920873260 tempest-VolumesNegativeTest-920873260-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.005910 Nov 15 12:48:23.768029 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 580/1131] 10.222.0.43 () {60 vars in 1155 bytes} [Mon Nov 15 12:48:23 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 15 12:48:23.776535 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-02025cc6-0f5b-4a0d-8335-201426abc497 tempest-VolumesNegativeTest-920873260 tempest-VolumesNegativeTest-920873260-project] Action: 'create', calling method: .version_select at 0x7f131b188550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1630518492", "metadata": {"Type": "work"}}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:48:23.777649 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-02025cc6-0f5b-4a0d-8335-201426abc497 tempest-VolumesNegativeTest-920873260 tempest-VolumesNegativeTest-920873260-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:48:23.778414 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-02025cc6-0f5b-4a0d-8335-201426abc497 tempest-VolumesNegativeTest-920873260 tempest-VolumesNegativeTest-920873260-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005367 Nov 15 12:48:23.778931 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 552/1132] 10.222.0.43 () {60 vars in 1155 bytes} [Mon Nov 15 12:48:23 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 6 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 15 12:48:23.787632 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-5d769f8b-c51c-4b65-9eec-a170a1bcd983 tempest-VolumesNegativeTest-920873260 tempest-VolumesNegativeTest-920873260-project] Calling method '.version_select at 0x7f13203744c0>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:48:23.816512 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.wsgi [None req-5d769f8b-c51c-4b65-9eec-a170a1bcd983 tempest-VolumesNegativeTest-920873260 tempest-VolumesNegativeTest-920873260-project] HTTP exception thrown: Volume tempest-invalid-837547703 could not be found. Nov 15 12:48:23.817113 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-5d769f8b-c51c-4b65-9eec-a170a1bcd983 tempest-VolumesNegativeTest-920873260 tempest-VolumesNegativeTest-920873260-project] Returning 404 to user: Volume tempest-invalid-837547703 could not be found. {{(pid=122567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:48:23.817936 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-5d769f8b-c51c-4b65-9eec-a170a1bcd983 tempest-VolumesNegativeTest-920873260 tempest-VolumesNegativeTest-920873260-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/tempest-invalid-837547703" status: 404 len: 98 microversion: 2.1 time: 0.034217 Nov 15 12:48:23.818471 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 581/1133] 10.222.0.43 () {58 vars in 1214 bytes} [Mon Nov 15 12:48:23 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-837547703 => generated 98 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 15 12:48:23.829037 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-98b35e47-b152-4da4-8543-f1d5e0d0968d tempest-VolumesNegativeTest-920873260 tempest-VolumesNegativeTest-920873260-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003608 Nov 15 12:48:23.829558 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 553/1134] 10.222.0.43 () {58 vars in 1139 bytes} [Mon Nov 15 12:48:23 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 15 12:48:23.838943 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-d4f6f860-12a5-4d8e-9002-18386d9712d0 tempest-VolumesNegativeTest-920873260 tempest-VolumesNegativeTest-920873260-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004077 Nov 15 12:48:23.839456 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 582/1135] 10.222.0.43 () {58 vars in 1136 bytes} [Mon Nov 15 12:48:23 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 15 12:48:23.847992 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-b354df48-8b31-4d0b-baa4-271536d73b81 tempest-VolumesNegativeTest-920873260 tempest-VolumesNegativeTest-920873260-project] Calling method '.version_select at 0x7f131b1889d0>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:48:23.877357 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.wsgi [None req-b354df48-8b31-4d0b-baa4-271536d73b81 tempest-VolumesNegativeTest-920873260 tempest-VolumesNegativeTest-920873260-project] HTTP exception thrown: Volume 3e82c57d-5f0b-4d6d-bc8d-8a05113e01c9 could not be found. Nov 15 12:48:23.877956 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-b354df48-8b31-4d0b-baa4-271536d73b81 tempest-VolumesNegativeTest-920873260 tempest-VolumesNegativeTest-920873260-project] Returning 404 to user: Volume 3e82c57d-5f0b-4d6d-bc8d-8a05113e01c9 could not be found. {{(pid=122568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:48:23.878810 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-b354df48-8b31-4d0b-baa4-271536d73b81 tempest-VolumesNegativeTest-920873260 tempest-VolumesNegativeTest-920873260-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/3e82c57d-5f0b-4d6d-bc8d-8a05113e01c9" status: 404 len: 109 microversion: 2.1 time: 0.034426 Nov 15 12:48:23.879367 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 554/1136] 10.222.0.43 () {58 vars in 1247 bytes} [Mon Nov 15 12:48:23 2021] DELETE /compute/v2.1/os-volumes/3e82c57d-5f0b-4d6d-bc8d-8a05113e01c9 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 15 12:48:23.890801 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-7cb6b59a-863b-4e62-ab9a-d1c81eec419b tempest-VolumesNegativeTest-920873260 tempest-VolumesNegativeTest-920873260-project] Calling method '.version_select at 0x7f13201abd30>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:48:23.917457 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.wsgi [None req-7cb6b59a-863b-4e62-ab9a-d1c81eec419b tempest-VolumesNegativeTest-920873260 tempest-VolumesNegativeTest-920873260-project] HTTP exception thrown: Volume 2b9a1cc9-0913-44c6-8462-be6bd9a6a94c could not be found. Nov 15 12:48:23.918066 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-7cb6b59a-863b-4e62-ab9a-d1c81eec419b tempest-VolumesNegativeTest-920873260 tempest-VolumesNegativeTest-920873260-project] Returning 404 to user: Volume 2b9a1cc9-0913-44c6-8462-be6bd9a6a94c could not be found. {{(pid=122567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:48:23.919187 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-7cb6b59a-863b-4e62-ab9a-d1c81eec419b tempest-VolumesNegativeTest-920873260 tempest-VolumesNegativeTest-920873260-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/2b9a1cc9-0913-44c6-8462-be6bd9a6a94c" status: 404 len: 109 microversion: 2.1 time: 0.032729 Nov 15 12:48:23.919718 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 583/1137] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Nov 15 12:48:23 2021] GET /compute/v2.1/os-volumes/2b9a1cc9-0913-44c6-8462-be6bd9a6a94c => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 15 12:48:52.541968 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-acc97523-6dae-4cd6-8327-624c666c5c8b tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Action: 'create', calling method: .version_select at 0x7f131b29f280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-127766071"}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:48:52.558312 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-acc97523-6dae-4cd6-8327-624c666c5c8b tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Getting quotas for project cb31629f759d420e90dae2332b8cf2f6. Resources: {'key_pairs'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:48:52.562429 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-acc97523-6dae-4cd6-8327-624c666c5c8b tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Getting quotas for user 43c2ab811f854cb18cbe42aae9a17c66 and project cb31629f759d420e90dae2332b8cf2f6. Resources: {'key_pairs'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:48:52.689914 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-acc97523-6dae-4cd6-8327-624c666c5c8b tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Getting quotas for project cb31629f759d420e90dae2332b8cf2f6. Resources: {'key_pairs'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:48:52.696889 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-acc97523-6dae-4cd6-8327-624c666c5c8b tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Getting quotas for user 43c2ab811f854cb18cbe42aae9a17c66 and project cb31629f759d420e90dae2332b8cf2f6. Resources: {'key_pairs'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:48:52.715991 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-acc97523-6dae-4cd6-8327-624c666c5c8b tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.179102 Nov 15 12:48:52.716590 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 555/1138] 10.222.0.43 () {60 vars in 1157 bytes} [Mon Nov 15 12:48:52 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:48:52.828505 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-1de4d8c2-a158-4c76-bd39-caac8f79b53d tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-813473564", "imageRef": "9b1603d7-ea83-47a5-9e50-3c28f2f4986f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-127766071", "networks": [{"uuid": "a483aac6-2387-4002-bd85-a241aea8f557"}]}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:48:52.879722 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.network.neutron [None req-1de4d8c2-a158-4c76-bd39-caac8f79b53d tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] validate_networks() for [('a483aac6-2387-4002-bd85-a241aea8f557', None, None, None, None, None)] {{(pid=122567) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 15 12:48:53.271708 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-1de4d8c2-a158-4c76-bd39-caac8f79b53d tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Flavor limits 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 15 12:48:53.272202 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-1de4d8c2-a158-4c76-bd39-caac8f79b53d tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Image limits 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 15 12:48:53.272731 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-1de4d8c2-a158-4c76-bd39-caac8f79b53d tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Flavor pref 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 15 12:48:53.273169 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-1de4d8c2-a158-4c76-bd39-caac8f79b53d tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Image pref 0:0:0 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 15 12:48:53.273573 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.virt.hardware [None req-1de4d8c2-a158-4c76-bd39-caac8f79b53d tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 15 12:48:53.282688 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1de4d8c2-a158-4c76-bd39-caac8f79b53d tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:53.283166 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1de4d8c2-a158-4c76-bd39-caac8f79b53d tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:53.284447 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1de4d8c2-a158-4c76-bd39-caac8f79b53d tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:53.284891 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1de4d8c2-a158-4c76-bd39-caac8f79b53d tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:53.301890 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.quota [None req-1de4d8c2-a158-4c76-bd39-caac8f79b53d tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Getting quotas for project cb31629f759d420e90dae2332b8cf2f6. Resources: {'cores', 'ram', 'instances'} {{(pid=122567) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:48:53.306742 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.quota [None req-1de4d8c2-a158-4c76-bd39-caac8f79b53d tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Getting quotas for user 43c2ab811f854cb18cbe42aae9a17c66 and project cb31629f759d420e90dae2332b8cf2f6. Resources: {'cores', 'ram', 'instances'} {{(pid=122567) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:48:53.318493 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-1de4d8c2-a158-4c76-bd39-caac8f79b53d tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Going to run 1 instances... {{(pid=122567) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 15 12:48:53.320824 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-1de4d8c2-a158-4c76-bd39-caac8f79b53d tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b1603d7-ea83-47a5-9e50-3c28f2f4986f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 15 12:48:53.368412 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-1de4d8c2-a158-4c76-bd39-caac8f79b53d tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543777 Nov 15 12:48:53.369631 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 584/1139] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Nov 15 12:48:52 2021] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 15 12:48:53.379326 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-62064a6b-b696-4226-b486-5c12db67e04c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:48:53.380051 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-62064a6b-b696-4226-b486-5c12db67e04c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:48:53.443056 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-62064a6b-b696-4226-b486-5c12db67e04c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:48:53.449997 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-62064a6b-b696-4226-b486-5c12db67e04c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1257 microversion: 2.1 time: 0.074391 Nov 15 12:48:53.450576 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 556/1140] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:48:53 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1257 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:48:54.468700 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-213a55d1-2d55-43f6-8e2f-750b39ee41be tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:48:54.469997 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-213a55d1-2d55-43f6-8e2f-750b39ee41be tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:48:54.476130 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-213a55d1-2d55-43f6-8e2f-750b39ee41be tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:54.476575 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-213a55d1-2d55-43f6-8e2f-750b39ee41be tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:54.478084 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-213a55d1-2d55-43f6-8e2f-750b39ee41be tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:54.478857 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-213a55d1-2d55-43f6-8e2f-750b39ee41be tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:54.544988 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-213a55d1-2d55-43f6-8e2f-750b39ee41be tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:48:54.552308 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-213a55d1-2d55-43f6-8e2f-750b39ee41be tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1327 microversion: 2.1 time: 0.087909 Nov 15 12:48:54.553595 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 585/1141] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:48:54 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1327 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:48:55.570740 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-fdc54536-9654-4392-91cc-62e76a6c56db tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:48:55.571910 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-fdc54536-9654-4392-91cc-62e76a6c56db tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:48:55.582126 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fdc54536-9654-4392-91cc-62e76a6c56db tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:55.582574 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fdc54536-9654-4392-91cc-62e76a6c56db tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:55.583474 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fdc54536-9654-4392-91cc-62e76a6c56db tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:55.583905 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-fdc54536-9654-4392-91cc-62e76a6c56db tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:55.747042 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-fdc54536-9654-4392-91cc-62e76a6c56db tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:48:55.754412 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-fdc54536-9654-4392-91cc-62e76a6c56db tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1357 microversion: 2.1 time: 0.188596 Nov 15 12:48:55.755013 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 557/1142] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:48:55 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1357 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:48:56.775892 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-7922e452-f069-4eaa-b7a9-84c7056194da tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:48:56.776607 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-7922e452-f069-4eaa-b7a9-84c7056194da tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:48:56.783195 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7922e452-f069-4eaa-b7a9-84c7056194da tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:56.783642 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7922e452-f069-4eaa-b7a9-84c7056194da tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:56.784431 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7922e452-f069-4eaa-b7a9-84c7056194da tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:56.784884 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7922e452-f069-4eaa-b7a9-84c7056194da tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:56.942342 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-7922e452-f069-4eaa-b7a9-84c7056194da tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:48:56.951529 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-7922e452-f069-4eaa-b7a9-84c7056194da tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1357 microversion: 2.1 time: 0.179305 Nov 15 12:48:56.952132 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 586/1143] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:48:56 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:48:57.969670 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-f3277558-def7-42a5-99f6-38a92abd6d47 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:48:57.970483 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-f3277558-def7-42a5-99f6-38a92abd6d47 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:48:57.977201 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f3277558-def7-42a5-99f6-38a92abd6d47 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:57.977781 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f3277558-def7-42a5-99f6-38a92abd6d47 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:57.978747 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f3277558-def7-42a5-99f6-38a92abd6d47 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:57.979381 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f3277558-def7-42a5-99f6-38a92abd6d47 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:58.131754 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-f3277558-def7-42a5-99f6-38a92abd6d47 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:48:58.139958 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-f3277558-def7-42a5-99f6-38a92abd6d47 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1357 microversion: 2.1 time: 0.173837 Nov 15 12:48:58.140832 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 558/1144] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:48:57 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:48:59.157754 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-ec0f392a-3150-4b7b-8379-1a2bc84b237a tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:48:59.158346 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-ec0f392a-3150-4b7b-8379-1a2bc84b237a tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:48:59.164945 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ec0f392a-3150-4b7b-8379-1a2bc84b237a tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:59.165399 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ec0f392a-3150-4b7b-8379-1a2bc84b237a tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:59.166190 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ec0f392a-3150-4b7b-8379-1a2bc84b237a tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:48:59.166625 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ec0f392a-3150-4b7b-8379-1a2bc84b237a tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:48:59.322479 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-ec0f392a-3150-4b7b-8379-1a2bc84b237a tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:48:59.329906 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-ec0f392a-3150-4b7b-8379-1a2bc84b237a tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1357 microversion: 2.1 time: 0.175876 Nov 15 12:48:59.330472 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 587/1145] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:48:59 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:00.347466 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-9072f8bb-4968-4e60-94a9-572cfdaf9ec6 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:00.348072 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-9072f8bb-4968-4e60-94a9-572cfdaf9ec6 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:00.355647 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9072f8bb-4968-4e60-94a9-572cfdaf9ec6 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:00.356089 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9072f8bb-4968-4e60-94a9-572cfdaf9ec6 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:00.356861 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9072f8bb-4968-4e60-94a9-572cfdaf9ec6 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:00.357291 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9072f8bb-4968-4e60-94a9-572cfdaf9ec6 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:00.510128 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-9072f8bb-4968-4e60-94a9-572cfdaf9ec6 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:00.517661 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-9072f8bb-4968-4e60-94a9-572cfdaf9ec6 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1357 microversion: 2.1 time: 0.173805 Nov 15 12:49:00.518230 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 559/1146] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:00 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:01.536517 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-6e8eac40-17b1-4eb0-845a-a2d7b2840cae tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:01.537124 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-6e8eac40-17b1-4eb0-845a-a2d7b2840cae tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:01.544310 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6e8eac40-17b1-4eb0-845a-a2d7b2840cae tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:01.544763 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6e8eac40-17b1-4eb0-845a-a2d7b2840cae tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:01.545606 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6e8eac40-17b1-4eb0-845a-a2d7b2840cae tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:01.546039 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6e8eac40-17b1-4eb0-845a-a2d7b2840cae tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:01.685346 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-6e8eac40-17b1-4eb0-845a-a2d7b2840cae tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:01.692733 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-6e8eac40-17b1-4eb0-845a-a2d7b2840cae tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1357 microversion: 2.1 time: 0.160017 Nov 15 12:49:01.693308 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 588/1147] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:01 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:02.710051 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-349da996-0dba-4503-bc21-88c35b6c79e5 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:02.710676 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-349da996-0dba-4503-bc21-88c35b6c79e5 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:02.717737 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-349da996-0dba-4503-bc21-88c35b6c79e5 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:02.718182 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-349da996-0dba-4503-bc21-88c35b6c79e5 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:02.719099 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-349da996-0dba-4503-bc21-88c35b6c79e5 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:02.719557 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-349da996-0dba-4503-bc21-88c35b6c79e5 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:02.870504 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-349da996-0dba-4503-bc21-88c35b6c79e5 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:02.881484 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-349da996-0dba-4503-bc21-88c35b6c79e5 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1357 microversion: 2.1 time: 0.174684 Nov 15 12:49:02.882556 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 560/1148] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:02 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:03.905945 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-2162d290-4855-4a8e-8ec1-eb442f919419 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:03.906540 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-2162d290-4855-4a8e-8ec1-eb442f919419 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:03.912764 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2162d290-4855-4a8e-8ec1-eb442f919419 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:03.913213 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2162d290-4855-4a8e-8ec1-eb442f919419 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:03.914043 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2162d290-4855-4a8e-8ec1-eb442f919419 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:03.914709 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2162d290-4855-4a8e-8ec1-eb442f919419 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:04.049064 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-2162d290-4855-4a8e-8ec1-eb442f919419 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:04.064216 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-2162d290-4855-4a8e-8ec1-eb442f919419 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1357 microversion: 2.1 time: 0.162721 Nov 15 12:49:04.064810 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 589/1149] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:03 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:49:05.084762 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-36e9e278-d01a-4e64-ab1a-121c349a8b3c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:05.084762 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-36e9e278-d01a-4e64-ab1a-121c349a8b3c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:05.094784 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-36e9e278-d01a-4e64-ab1a-121c349a8b3c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:05.095608 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-36e9e278-d01a-4e64-ab1a-121c349a8b3c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:05.096091 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-36e9e278-d01a-4e64-ab1a-121c349a8b3c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:05.096518 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-36e9e278-d01a-4e64-ab1a-121c349a8b3c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:05.242981 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-36e9e278-d01a-4e64-ab1a-121c349a8b3c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:05.251306 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-36e9e278-d01a-4e64-ab1a-121c349a8b3c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1357 microversion: 2.1 time: 0.173414 Nov 15 12:49:05.252464 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 561/1150] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:05 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:06.268861 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-842cbd01-d2c0-4f5a-9ab5-341f628972cf tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:06.269506 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-842cbd01-d2c0-4f5a-9ab5-341f628972cf tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:06.275849 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-842cbd01-d2c0-4f5a-9ab5-341f628972cf tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:06.276292 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-842cbd01-d2c0-4f5a-9ab5-341f628972cf tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:06.277071 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-842cbd01-d2c0-4f5a-9ab5-341f628972cf tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:06.277498 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-842cbd01-d2c0-4f5a-9ab5-341f628972cf tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:06.421123 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-842cbd01-d2c0-4f5a-9ab5-341f628972cf tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:06.429223 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-842cbd01-d2c0-4f5a-9ab5-341f628972cf tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1357 microversion: 2.1 time: 0.163947 Nov 15 12:49:06.435721 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 590/1151] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:06 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:07.446038 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-b7a77d3d-5661-42e5-a4c7-8334a1b66c88 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:07.446681 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-b7a77d3d-5661-42e5-a4c7-8334a1b66c88 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:07.452795 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b7a77d3d-5661-42e5-a4c7-8334a1b66c88 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:07.453179 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b7a77d3d-5661-42e5-a4c7-8334a1b66c88 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:07.453952 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b7a77d3d-5661-42e5-a4c7-8334a1b66c88 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:07.454380 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b7a77d3d-5661-42e5-a4c7-8334a1b66c88 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:07.590091 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-b7a77d3d-5661-42e5-a4c7-8334a1b66c88 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:07.597580 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-b7a77d3d-5661-42e5-a4c7-8334a1b66c88 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1357 microversion: 2.1 time: 0.155772 Nov 15 12:49:07.598151 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 562/1152] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:07 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:08.616055 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-a0abc0a8-1147-4603-884c-8975984e134b tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:08.616651 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-a0abc0a8-1147-4603-884c-8975984e134b tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:08.622693 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a0abc0a8-1147-4603-884c-8975984e134b tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:08.623168 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a0abc0a8-1147-4603-884c-8975984e134b tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:08.623942 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a0abc0a8-1147-4603-884c-8975984e134b tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:08.624410 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-a0abc0a8-1147-4603-884c-8975984e134b tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:08.766553 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-a0abc0a8-1147-4603-884c-8975984e134b tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:08.774976 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-a0abc0a8-1147-4603-884c-8975984e134b tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1357 microversion: 2.1 time: 0.162425 Nov 15 12:49:08.778266 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 591/1153] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:08 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:08.980906 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-0596a7e0-a835-47c4-8e4d-d8fd37e93d86 req-64bb43a5-ace1-4cbe-a6ef-7e58d90ca9f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b384711-646f-4693-b6da-0c50ca5d70df", "tag": "6c4dacb1-ba9b-41c5-9682-a84812cc49d9"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:49:08.982527 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:49:08.982527 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:49:09.003870 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-0596a7e0-a835-47c4-8e4d-d8fd37e93d86 req-64bb43a5-ace1-4cbe-a6ef-7e58d90ca9f3 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:09.004319 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-0596a7e0-a835-47c4-8e4d-d8fd37e93d86 req-64bb43a5-ace1-4cbe-a6ef-7e58d90ca9f3 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:09.018094 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-0596a7e0-a835-47c4-8e4d-d8fd37e93d86 req-64bb43a5-ace1-4cbe-a6ef-7e58d90ca9f3 service nova] Creating event network-changed:6c4dacb1-ba9b-41c5-9682-a84812cc49d9 for instance 5b384711-646f-4693-b6da-0c50ca5d70df on hv-cinder-68088 Nov 15 12:49:09.024389 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-0596a7e0-a835-47c4-8e4d-d8fd37e93d86 req-64bb43a5-ace1-4cbe-a6ef-7e58d90ca9f3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048971 Nov 15 12:49:09.025003 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 563/1154] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:49:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 15 12:49:09.792274 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-df64709a-5219-414c-9204-684ec116efb1 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:09.793170 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-df64709a-5219-414c-9204-684ec116efb1 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:09.799753 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-df64709a-5219-414c-9204-684ec116efb1 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:09.800271 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-df64709a-5219-414c-9204-684ec116efb1 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:09.801051 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-df64709a-5219-414c-9204-684ec116efb1 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:09.801481 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-df64709a-5219-414c-9204-684ec116efb1 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:09.936698 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-df64709a-5219-414c-9204-684ec116efb1 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:09.944635 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-df64709a-5219-414c-9204-684ec116efb1 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1357 microversion: 2.1 time: 0.156678 Nov 15 12:49:09.945150 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 592/1155] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:09 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:10.968403 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-6793d86f-7593-4e39-8dfe-b2322cefad79 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:10.969181 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-6793d86f-7593-4e39-8dfe-b2322cefad79 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:10.975279 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6793d86f-7593-4e39-8dfe-b2322cefad79 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:10.975726 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6793d86f-7593-4e39-8dfe-b2322cefad79 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:10.977134 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6793d86f-7593-4e39-8dfe-b2322cefad79 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:10.977566 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-6793d86f-7593-4e39-8dfe-b2322cefad79 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:11.115038 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-6793d86f-7593-4e39-8dfe-b2322cefad79 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:11.122460 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-6793d86f-7593-4e39-8dfe-b2322cefad79 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1357 microversion: 2.1 time: 0.158587 Nov 15 12:49:11.123074 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 564/1156] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:10 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:49:12.140513 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-62382800-08f4-4214-8253-f2264e079c1e tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:12.141162 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-62382800-08f4-4214-8253-f2264e079c1e tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:12.147221 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-62382800-08f4-4214-8253-f2264e079c1e tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:12.147752 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-62382800-08f4-4214-8253-f2264e079c1e tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:12.148603 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-62382800-08f4-4214-8253-f2264e079c1e tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:12.149107 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-62382800-08f4-4214-8253-f2264e079c1e tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:12.293538 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-62382800-08f4-4214-8253-f2264e079c1e tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:12.301167 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-62382800-08f4-4214-8253-f2264e079c1e tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1357 microversion: 2.1 time: 0.164839 Nov 15 12:49:12.301803 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 593/1157] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:12 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:13.317978 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-839344c6-8ba6-4109-8c04-618c2c02a37f tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:13.318585 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-839344c6-8ba6-4109-8c04-618c2c02a37f tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:13.325704 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-839344c6-8ba6-4109-8c04-618c2c02a37f tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:13.326148 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-839344c6-8ba6-4109-8c04-618c2c02a37f tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:13.326986 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-839344c6-8ba6-4109-8c04-618c2c02a37f tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:13.327419 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-839344c6-8ba6-4109-8c04-618c2c02a37f tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:13.464186 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-839344c6-8ba6-4109-8c04-618c2c02a37f tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:13.471593 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-839344c6-8ba6-4109-8c04-618c2c02a37f tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1357 microversion: 2.1 time: 0.157230 Nov 15 12:49:13.472176 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 565/1158] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:13 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:14.488247 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-af43772e-ecc3-45bf-81ed-36ed0ba095d3 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:14.488821 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-af43772e-ecc3-45bf-81ed-36ed0ba095d3 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:14.495431 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-af43772e-ecc3-45bf-81ed-36ed0ba095d3 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:14.495882 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-af43772e-ecc3-45bf-81ed-36ed0ba095d3 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:14.496667 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-af43772e-ecc3-45bf-81ed-36ed0ba095d3 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:14.497095 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-af43772e-ecc3-45bf-81ed-36ed0ba095d3 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:14.629636 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-af43772e-ecc3-45bf-81ed-36ed0ba095d3 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:14.637768 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-af43772e-ecc3-45bf-81ed-36ed0ba095d3 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1357 microversion: 2.1 time: 0.153303 Nov 15 12:49:14.638359 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 594/1159] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:14 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:15.020161 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-38b880b5-ca36-4fba-ad10-9f7fcfce594a req-5e86b309-7443-4801-a2f5-95190d712f29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b384711-646f-4693-b6da-0c50ca5d70df", "name": "network-vif-plugged", "status": "completed", "tag": "6c4dacb1-ba9b-41c5-9682-a84812cc49d9"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:49:15.022087 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:49:15.022087 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:49:15.030972 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-38b880b5-ca36-4fba-ad10-9f7fcfce594a req-5e86b309-7443-4801-a2f5-95190d712f29 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:15.031406 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-38b880b5-ca36-4fba-ad10-9f7fcfce594a req-5e86b309-7443-4801-a2f5-95190d712f29 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:15.044468 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-38b880b5-ca36-4fba-ad10-9f7fcfce594a req-5e86b309-7443-4801-a2f5-95190d712f29 service nova] Creating event network-vif-plugged:6c4dacb1-ba9b-41c5-9682-a84812cc49d9 for instance 5b384711-646f-4693-b6da-0c50ca5d70df on hv-cinder-68088 Nov 15 12:49:15.049291 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-38b880b5-ca36-4fba-ad10-9f7fcfce594a req-5e86b309-7443-4801-a2f5-95190d712f29 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032797 Nov 15 12:49:15.050126 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 566/1160] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:49:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:49:15.655544 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-c04f184c-8c53-4947-9733-319c5765901b tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:15.656072 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-c04f184c-8c53-4947-9733-319c5765901b tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:15.662354 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c04f184c-8c53-4947-9733-319c5765901b tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:15.662819 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c04f184c-8c53-4947-9733-319c5765901b tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:15.663590 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c04f184c-8c53-4947-9733-319c5765901b tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:15.664016 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c04f184c-8c53-4947-9733-319c5765901b tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:15.793905 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-c04f184c-8c53-4947-9733-319c5765901b tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:15.801165 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-c04f184c-8c53-4947-9733-319c5765901b tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1357 microversion: 2.1 time: 0.149447 Nov 15 12:49:15.801721 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 595/1161] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:15 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:16.819664 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-d0d12ba7-4350-4d62-bd87-b8099ff6cd18 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:16.820343 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-d0d12ba7-4350-4d62-bd87-b8099ff6cd18 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:16.826579 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d0d12ba7-4350-4d62-bd87-b8099ff6cd18 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:16.827041 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d0d12ba7-4350-4d62-bd87-b8099ff6cd18 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:16.827796 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d0d12ba7-4350-4d62-bd87-b8099ff6cd18 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:16.828219 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-d0d12ba7-4350-4d62-bd87-b8099ff6cd18 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:16.968423 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-d0d12ba7-4350-4d62-bd87-b8099ff6cd18 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:16.975756 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-d0d12ba7-4350-4d62-bd87-b8099ff6cd18 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1546 microversion: 2.1 time: 0.160491 Nov 15 12:49:16.976322 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 567/1162] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:16 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1546 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:16.992243 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-6914d349-e46f-43d2-b1d8-d739d5d4f79a tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:16.993263 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-6914d349-e46f-43d2-b1d8-d739d5d4f79a tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:16.999589 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6914d349-e46f-43d2-b1d8-d739d5d4f79a tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:17.000041 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6914d349-e46f-43d2-b1d8-d739d5d4f79a tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:17.000812 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6914d349-e46f-43d2-b1d8-d739d5d4f79a tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:17.001242 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6914d349-e46f-43d2-b1d8-d739d5d4f79a tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:17.133261 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-6914d349-e46f-43d2-b1d8-d739d5d4f79a tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:17.141748 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-6914d349-e46f-43d2-b1d8-d739d5d4f79a tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1546 microversion: 2.1 time: 0.153142 Nov 15 12:49:17.142320 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 596/1163] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:16 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1546 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:17.158378 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-020f70bb-d75a-4de1-812c-d6c469bda552 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:17.161677 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:49:17.161677 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:49:17.162652 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-020f70bb-d75a-4de1-812c-d6c469bda552 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:17.163428 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-020f70bb-d75a-4de1-812c-d6c469bda552 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Searching by: {'deleted': False, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6'} {{(pid=122568) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 15 12:49:17.170755 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-020f70bb-d75a-4de1-812c-d6c469bda552 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:17.171220 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-020f70bb-d75a-4de1-812c-d6c469bda552 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:17.172108 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-020f70bb-d75a-4de1-812c-d6c469bda552 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:17.172549 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-020f70bb-d75a-4de1-812c-d6c469bda552 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:17.410473 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.multi_cell_list [None req-020f70bb-d75a-4de1-812c-d6c469bda552 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 15 12:49:17.504424 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-020f70bb-d75a-4de1-812c-d6c469bda552 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.349493 Nov 15 12:49:17.505004 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 568/1164] 10.222.0.43 () {58 vars in 1124 bytes} [Mon Nov 15 12:49:17 2021] GET /compute/v2.1/servers => generated 342 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:49:17.515075 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-78f18043-a29b-4520-82c3-3c7d913da90a tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:17.515689 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-78f18043-a29b-4520-82c3-3c7d913da90a tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:17.521521 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-78f18043-a29b-4520-82c3-3c7d913da90a tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:17.521970 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-78f18043-a29b-4520-82c3-3c7d913da90a tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:17.522738 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-78f18043-a29b-4520-82c3-3c7d913da90a tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:17.523197 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-78f18043-a29b-4520-82c3-3c7d913da90a tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:17.667968 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-78f18043-a29b-4520-82c3-3c7d913da90a tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:17.675288 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-78f18043-a29b-4520-82c3-3c7d913da90a tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1546 microversion: 2.1 time: 0.163784 Nov 15 12:49:17.675856 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 597/1165] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:17 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1546 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:19.171315 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-a57832c8-c582-4fa7-bf87-2ee23779d053 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ddbaf25a-997c-4ee2-8d07-91614a2c1867"}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:49:19.172361 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-a57832c8-c582-4fa7-bf87-2ee23779d053 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:19.178640 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a57832c8-c582-4fa7-bf87-2ee23779d053 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:19.179133 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a57832c8-c582-4fa7-bf87-2ee23779d053 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:19.179894 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a57832c8-c582-4fa7-bf87-2ee23779d053 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:19.180471 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a57832c8-c582-4fa7-bf87-2ee23779d053 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:19.432969 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-a57832c8-c582-4fa7-bf87-2ee23779d053 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "POST /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265455 Nov 15 12:49:19.433565 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 569/1166] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Nov 15 12:49:19 2021] POST /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 15 12:49:26.954178 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-aefdd407-2680-4f54-943f-01e1c90daf9f tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:26.954846 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-aefdd407-2680-4f54-943f-01e1c90daf9f tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:26.961241 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-aefdd407-2680-4f54-943f-01e1c90daf9f tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:26.961894 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-aefdd407-2680-4f54-943f-01e1c90daf9f tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:26.962860 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-aefdd407-2680-4f54-943f-01e1c90daf9f tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:26.963295 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-aefdd407-2680-4f54-943f-01e1c90daf9f tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:27.092078 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-aefdd407-2680-4f54-943f-01e1c90daf9f tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:27.099832 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-aefdd407-2680-4f54-943f-01e1c90daf9f tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1592 microversion: 2.1 time: 0.149319 Nov 15 12:49:27.100397 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 598/1167] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:26 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1592 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:28.914961 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-5ea1c027-2204-4b49-8010-ea96b88cdc23 req-f8cf84e7-d8dc-48bc-8b41-3fe5fc8213c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b384711-646f-4693-b6da-0c50ca5d70df", "tag": "6c4dacb1-ba9b-41c5-9682-a84812cc49d9"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:49:28.916643 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:49:28.916643 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:49:28.924244 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-5ea1c027-2204-4b49-8010-ea96b88cdc23 req-f8cf84e7-d8dc-48bc-8b41-3fe5fc8213c9 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:28.924678 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-5ea1c027-2204-4b49-8010-ea96b88cdc23 req-f8cf84e7-d8dc-48bc-8b41-3fe5fc8213c9 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:28.938079 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-5ea1c027-2204-4b49-8010-ea96b88cdc23 req-f8cf84e7-d8dc-48bc-8b41-3fe5fc8213c9 service nova] Creating event network-changed:6c4dacb1-ba9b-41c5-9682-a84812cc49d9 for instance 5b384711-646f-4693-b6da-0c50ca5d70df on hv-cinder-68088 Nov 15 12:49:28.943848 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-5ea1c027-2204-4b49-8010-ea96b88cdc23 req-f8cf84e7-d8dc-48bc-8b41-3fe5fc8213c9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032660 Nov 15 12:49:28.944836 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 570/1168] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:49:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:49:29.975710 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-75ef2322-0739-44db-bd71-c45bb30a29db tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-950017187"}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:49:29.976247 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-75ef2322-0739-44db-bd71-c45bb30a29db tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:29.983808 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-75ef2322-0739-44db-bd71-c45bb30a29db tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:29.984273 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-75ef2322-0739-44db-bd71-c45bb30a29db tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:29.985245 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-75ef2322-0739-44db-bd71-c45bb30a29db tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:29.985674 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-75ef2322-0739-44db-bd71-c45bb30a29db tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:30.130398 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.network.security_group_api [None req-75ef2322-0739-44db-bd71-c45bb30a29db tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Adding security group bff84037-40b7-4670-a60a-d1d21d677b3c to port 6c4dacb1-ba9b-41c5-9682-a84812cc49d9 Nov 15 12:49:30.729600 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-75ef2322-0739-44db-bd71-c45bb30a29db tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "POST /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df/action" status: 202 len: 0 microversion: 2.1 time: 0.757625 Nov 15 12:49:30.730430 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 599/1169] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:49:29 2021] POST /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df/action => generated 0 bytes in 759 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 15 12:49:30.740270 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-de551d59-0b13-41d9-8bc9-c83939a38957 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:30.740970 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-de551d59-0b13-41d9-8bc9-c83939a38957 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:30.748364 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-de551d59-0b13-41d9-8bc9-c83939a38957 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:30.748799 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-de551d59-0b13-41d9-8bc9-c83939a38957 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:30.749835 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-de551d59-0b13-41d9-8bc9-c83939a38957 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:30.750634 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-de551d59-0b13-41d9-8bc9-c83939a38957 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:30.924116 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-de551d59-0b13-41d9-8bc9-c83939a38957 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:30.932817 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-de551d59-0b13-41d9-8bc9-c83939a38957 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1757 microversion: 2.1 time: 0.197980 Nov 15 12:49:30.933596 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 571/1170] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:30 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1757 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:30.960089 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [req-0461552e-e467-42b2-920b-5e2182929f4a req-bbb7e334-66e4-435e-a5c2-ffa9f2f78c12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b384711-646f-4693-b6da-0c50ca5d70df", "tag": "6c4dacb1-ba9b-41c5-9682-a84812cc49d9"}]} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:49:30.963103 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:49:30.963103 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: warnings.warn(msg) Nov 15 12:49:30.970200 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-0461552e-e467-42b2-920b-5e2182929f4a req-bbb7e334-66e4-435e-a5c2-ffa9f2f78c12 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:30.970575 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-0461552e-e467-42b2-920b-5e2182929f4a req-bbb7e334-66e4-435e-a5c2-ffa9f2f78c12 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:30.983088 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.compute.server_external_events [req-0461552e-e467-42b2-920b-5e2182929f4a req-bbb7e334-66e4-435e-a5c2-ffa9f2f78c12 service nova] Creating event network-changed:6c4dacb1-ba9b-41c5-9682-a84812cc49d9 for instance 5b384711-646f-4693-b6da-0c50ca5d70df on hv-cinder-68088 Nov 15 12:49:30.988258 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [req-0461552e-e467-42b2-920b-5e2182929f4a req-bbb7e334-66e4-435e-a5c2-ffa9f2f78c12 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031895 Nov 15 12:49:30.988959 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 600/1171] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:49:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:49:36.041221 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 15 12:49:36.041753 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: Mon Nov 15 12:49:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 15 12:49:40.419135 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-f698a4bf-3696-4579-9fda-349d5993998d tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-225426100", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1935274887", "security_groups": [{"name": "tempest-secgroup-smoke-1331826370"}], "block_device_mapping_v2": [{"uuid": "adf6f50b-3aed-4020-a80f-1e72155adcee", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f4599fcb-fdea-4045-9c9c-3e445269e7ec"}]}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:49:40.684439 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.network.neutron [None req-f698a4bf-3696-4579-9fda-349d5993998d tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] validate_networks() for [('f4599fcb-fdea-4045-9c9c-3e445269e7ec', None, None, None, None, None)] {{(pid=122568) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 15 12:49:41.078173 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-f698a4bf-3696-4579-9fda-349d5993998d tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Flavor limits 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 15 12:49:41.078587 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-f698a4bf-3696-4579-9fda-349d5993998d tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Image limits 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 15 12:49:41.079096 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-f698a4bf-3696-4579-9fda-349d5993998d tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Flavor pref 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 15 12:49:41.079615 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-f698a4bf-3696-4579-9fda-349d5993998d tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Image pref 0:0:0 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 15 12:49:41.080020 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.virt.hardware [None req-f698a4bf-3696-4579-9fda-349d5993998d tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 15 12:49:41.088749 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f698a4bf-3696-4579-9fda-349d5993998d tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:41.089192 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f698a4bf-3696-4579-9fda-349d5993998d tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:41.090026 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f698a4bf-3696-4579-9fda-349d5993998d tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:41.090457 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-f698a4bf-3696-4579-9fda-349d5993998d tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:41.108198 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-f698a4bf-3696-4579-9fda-349d5993998d tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Getting quotas for project f78fedf356a24ea182428c85682330f1. Resources: {'cores', 'ram', 'instances'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 15 12:49:41.112128 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.quota [None req-f698a4bf-3696-4579-9fda-349d5993998d tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Getting quotas for user 84c8f2a4f7c84026859778c12d6f7c35 and project f78fedf356a24ea182428c85682330f1. Resources: {'cores', 'ram', 'instances'} {{(pid=122568) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 15 12:49:41.168745 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-f698a4bf-3696-4579-9fda-349d5993998d tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Going to run 1 instances... {{(pid=122568) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 15 12:49:41.170914 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-f698a4bf-3696-4579-9fda-349d5993998d tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 2d63a34d-c889-4e35-8f01-d574369c19ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='adf6f50b-3aed-4020-a80f-1e72155adcee',volume_size=None,volume_type=None)] {{(pid=122568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 15 12:49:41.304043 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-f698a4bf-3696-4579-9fda-349d5993998d tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.888396 Nov 15 12:49:41.305362 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 572/1172] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Nov 15 12:49:40 2021] POST /compute/v2.1/servers => generated 406 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 15 12:49:41.317284 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-c5b9f6ab-318b-43f9-82f7-be21dc2e1b21 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:41.318006 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-c5b9f6ab-318b-43f9-82f7-be21dc2e1b21 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 2d63a34d-c889-4e35-8f01-d574369c19ba] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:41.480049 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-c5b9f6ab-318b-43f9-82f7-be21dc2e1b21 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:41.488754 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-c5b9f6ab-318b-43f9-82f7-be21dc2e1b21 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba" status: 200 len: 1094 microversion: 2.1 time: 0.175940 Nov 15 12:49:41.489409 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 601/1173] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:41 2021] GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba => generated 1094 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:49:42.506144 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-695f0fb2-7c3e-4bc9-a4f6-d851da9d0545 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:42.506695 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-695f0fb2-7c3e-4bc9-a4f6-d851da9d0545 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 2d63a34d-c889-4e35-8f01-d574369c19ba] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:42.513791 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-695f0fb2-7c3e-4bc9-a4f6-d851da9d0545 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:42.514273 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-695f0fb2-7c3e-4bc9-a4f6-d851da9d0545 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:42.515078 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-695f0fb2-7c3e-4bc9-a4f6-d851da9d0545 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:42.515514 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-695f0fb2-7c3e-4bc9-a4f6-d851da9d0545 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:42.577546 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-695f0fb2-7c3e-4bc9-a4f6-d851da9d0545 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:42.585537 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-695f0fb2-7c3e-4bc9-a4f6-d851da9d0545 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba" status: 200 len: 1192 microversion: 2.1 time: 0.083651 Nov 15 12:49:42.586115 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 573/1174] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:42 2021] GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba => generated 1192 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:43.603466 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-77ec0da4-7010-436a-a0e6-d49792412e91 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:43.604263 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-77ec0da4-7010-436a-a0e6-d49792412e91 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 2d63a34d-c889-4e35-8f01-d574369c19ba] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:43.611119 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-77ec0da4-7010-436a-a0e6-d49792412e91 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:43.611662 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-77ec0da4-7010-436a-a0e6-d49792412e91 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:43.612444 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-77ec0da4-7010-436a-a0e6-d49792412e91 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:43.613522 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-77ec0da4-7010-436a-a0e6-d49792412e91 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:43.747962 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-77ec0da4-7010-436a-a0e6-d49792412e91 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:43.755307 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-77ec0da4-7010-436a-a0e6-d49792412e91 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba" status: 200 len: 1266 microversion: 2.1 time: 0.155916 Nov 15 12:49:43.755880 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 602/1175] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:43 2021] GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:44.029833 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-88e2b13e-06fd-4e1b-90ea-5168c05ebe97 req-c4f4cdf2-61b5-4408-84d5-d328715a89df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d63a34d-c889-4e35-8f01-d574369c19ba", "tag": "078b27cb-8ab0-41e8-b3d0-544340291443"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:49:44.032084 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:49:44.032084 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:49:44.046096 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-88e2b13e-06fd-4e1b-90ea-5168c05ebe97 req-c4f4cdf2-61b5-4408-84d5-d328715a89df service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:44.046524 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-88e2b13e-06fd-4e1b-90ea-5168c05ebe97 req-c4f4cdf2-61b5-4408-84d5-d328715a89df service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:44.062477 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-88e2b13e-06fd-4e1b-90ea-5168c05ebe97 req-c4f4cdf2-61b5-4408-84d5-d328715a89df service nova] Creating event network-changed:078b27cb-8ab0-41e8-b3d0-544340291443 for instance 2d63a34d-c889-4e35-8f01-d574369c19ba on hv-cinder-68088 Nov 15 12:49:44.067639 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-88e2b13e-06fd-4e1b-90ea-5168c05ebe97 req-c4f4cdf2-61b5-4408-84d5-d328715a89df service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043064 Nov 15 12:49:44.068744 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 574/1176] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:49:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:49:44.772450 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e5eb8a10-b0cb-41e7-85b4-3f788d2a0345 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:44.773190 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e5eb8a10-b0cb-41e7-85b4-3f788d2a0345 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 2d63a34d-c889-4e35-8f01-d574369c19ba] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:44.780305 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e5eb8a10-b0cb-41e7-85b4-3f788d2a0345 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:44.780757 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e5eb8a10-b0cb-41e7-85b4-3f788d2a0345 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:44.781549 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e5eb8a10-b0cb-41e7-85b4-3f788d2a0345 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:44.781984 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e5eb8a10-b0cb-41e7-85b4-3f788d2a0345 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:44.926446 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e5eb8a10-b0cb-41e7-85b4-3f788d2a0345 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:44.934449 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e5eb8a10-b0cb-41e7-85b4-3f788d2a0345 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba" status: 200 len: 1266 microversion: 2.1 time: 0.165698 Nov 15 12:49:44.935051 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 603/1177] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:44 2021] GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:45.951856 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-115afecc-efe6-4a8d-a4eb-2217a88e72d1 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:45.952548 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-115afecc-efe6-4a8d-a4eb-2217a88e72d1 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 2d63a34d-c889-4e35-8f01-d574369c19ba] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:45.959010 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-115afecc-efe6-4a8d-a4eb-2217a88e72d1 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:45.959452 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-115afecc-efe6-4a8d-a4eb-2217a88e72d1 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:45.960217 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-115afecc-efe6-4a8d-a4eb-2217a88e72d1 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:45.960649 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-115afecc-efe6-4a8d-a4eb-2217a88e72d1 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:46.093885 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-115afecc-efe6-4a8d-a4eb-2217a88e72d1 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:46.101156 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-115afecc-efe6-4a8d-a4eb-2217a88e72d1 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba" status: 200 len: 1266 microversion: 2.1 time: 0.153373 Nov 15 12:49:46.101718 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 575/1178] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:45 2021] GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:47.117512 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-26acc027-5eac-4bb5-a384-31bb016c98ee tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:47.118108 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-26acc027-5eac-4bb5-a384-31bb016c98ee tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 2d63a34d-c889-4e35-8f01-d574369c19ba] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:47.130227 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-26acc027-5eac-4bb5-a384-31bb016c98ee tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:47.130673 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-26acc027-5eac-4bb5-a384-31bb016c98ee tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:47.131506 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-26acc027-5eac-4bb5-a384-31bb016c98ee tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:47.133261 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-26acc027-5eac-4bb5-a384-31bb016c98ee tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:47.273001 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-26acc027-5eac-4bb5-a384-31bb016c98ee tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:47.281117 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-26acc027-5eac-4bb5-a384-31bb016c98ee tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba" status: 200 len: 1266 microversion: 2.1 time: 0.167283 Nov 15 12:49:47.281700 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 604/1179] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:47 2021] GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:48.298098 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-676748f3-850a-420b-a484-bbfc216c8084 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:48.298702 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-676748f3-850a-420b-a484-bbfc216c8084 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 2d63a34d-c889-4e35-8f01-d574369c19ba] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:48.305074 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-676748f3-850a-420b-a484-bbfc216c8084 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:48.305507 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-676748f3-850a-420b-a484-bbfc216c8084 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:48.306338 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-676748f3-850a-420b-a484-bbfc216c8084 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:48.307029 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-676748f3-850a-420b-a484-bbfc216c8084 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:48.442889 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-676748f3-850a-420b-a484-bbfc216c8084 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:48.450253 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-676748f3-850a-420b-a484-bbfc216c8084 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba" status: 200 len: 1266 microversion: 2.1 time: 0.155812 Nov 15 12:49:48.450836 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 576/1180] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:48 2021] GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:49.466933 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-12321204-8826-4e64-aac5-11b17294fda4 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:49.467511 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-12321204-8826-4e64-aac5-11b17294fda4 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 2d63a34d-c889-4e35-8f01-d574369c19ba] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:49.474657 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-12321204-8826-4e64-aac5-11b17294fda4 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:49.475137 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-12321204-8826-4e64-aac5-11b17294fda4 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:49.476170 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-12321204-8826-4e64-aac5-11b17294fda4 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:49.476364 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-12321204-8826-4e64-aac5-11b17294fda4 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:49.624021 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-12321204-8826-4e64-aac5-11b17294fda4 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:49.632187 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-12321204-8826-4e64-aac5-11b17294fda4 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba" status: 200 len: 1266 microversion: 2.1 time: 0.169112 Nov 15 12:49:49.632782 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 605/1181] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:49 2021] GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:50.648867 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-3aed4e91-9315-44b8-a8e2-5488bbf10819 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:50.649420 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-3aed4e91-9315-44b8-a8e2-5488bbf10819 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 2d63a34d-c889-4e35-8f01-d574369c19ba] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:50.656010 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3aed4e91-9315-44b8-a8e2-5488bbf10819 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:50.656511 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3aed4e91-9315-44b8-a8e2-5488bbf10819 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:50.657427 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3aed4e91-9315-44b8-a8e2-5488bbf10819 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:50.657866 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-3aed4e91-9315-44b8-a8e2-5488bbf10819 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:50.788739 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-3aed4e91-9315-44b8-a8e2-5488bbf10819 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:50.797156 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-3aed4e91-9315-44b8-a8e2-5488bbf10819 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba" status: 200 len: 1266 microversion: 2.1 time: 0.152081 Nov 15 12:49:50.797724 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 577/1182] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:50 2021] GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:51.813397 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-3919be80-0041-4155-ae6c-f1b8a65c25f7 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:51.814015 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-3919be80-0041-4155-ae6c-f1b8a65c25f7 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 2d63a34d-c889-4e35-8f01-d574369c19ba] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:51.820303 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3919be80-0041-4155-ae6c-f1b8a65c25f7 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:51.820755 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3919be80-0041-4155-ae6c-f1b8a65c25f7 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:51.821531 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3919be80-0041-4155-ae6c-f1b8a65c25f7 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:51.822564 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-3919be80-0041-4155-ae6c-f1b8a65c25f7 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:51.957357 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-3919be80-0041-4155-ae6c-f1b8a65c25f7 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:51.964856 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-3919be80-0041-4155-ae6c-f1b8a65c25f7 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba" status: 200 len: 1266 microversion: 2.1 time: 0.155236 Nov 15 12:49:51.965424 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 606/1183] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:51 2021] GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:49:52.981740 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-321e90a5-fac4-481d-960a-870c8dfb84af tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:52.982386 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-321e90a5-fac4-481d-960a-870c8dfb84af tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 2d63a34d-c889-4e35-8f01-d574369c19ba] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:52.988554 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-321e90a5-fac4-481d-960a-870c8dfb84af tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:52.988991 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-321e90a5-fac4-481d-960a-870c8dfb84af tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:52.989747 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-321e90a5-fac4-481d-960a-870c8dfb84af tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:52.990169 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-321e90a5-fac4-481d-960a-870c8dfb84af tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:53.126653 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-321e90a5-fac4-481d-960a-870c8dfb84af tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:53.134102 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-321e90a5-fac4-481d-960a-870c8dfb84af tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba" status: 200 len: 1266 microversion: 2.1 time: 0.156495 Nov 15 12:49:53.135537 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 578/1184] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:52 2021] GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:53.299507 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-216e2689-724f-4757-837e-cfa92d8c7330 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:49:53.300466 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-216e2689-724f-4757-837e-cfa92d8c7330 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:53.306881 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-216e2689-724f-4757-837e-cfa92d8c7330 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:53.307327 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-216e2689-724f-4757-837e-cfa92d8c7330 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:53.308099 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-216e2689-724f-4757-837e-cfa92d8c7330 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:53.309062 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-216e2689-724f-4757-837e-cfa92d8c7330 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:53.382607 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-216e2689-724f-4757-837e-cfa92d8c7330 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "POST /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df/action" status: 202 len: 0 microversion: 2.1 time: 0.086549 Nov 15 12:49:53.384475 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 607/1185] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:49:53 2021] POST /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:49:53.392773 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-8d1eab80-cc73-4c3d-942f-0dd4d939566c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:53.393878 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-8d1eab80-cc73-4c3d-942f-0dd4d939566c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:53.406159 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8d1eab80-cc73-4c3d-942f-0dd4d939566c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:53.406609 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8d1eab80-cc73-4c3d-942f-0dd4d939566c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:53.407513 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8d1eab80-cc73-4c3d-942f-0dd4d939566c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:53.407981 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-8d1eab80-cc73-4c3d-942f-0dd4d939566c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:53.565196 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-8d1eab80-cc73-4c3d-942f-0dd4d939566c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:53.574097 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-8d1eab80-cc73-4c3d-942f-0dd4d939566c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1749 microversion: 2.1 time: 0.185191 Nov 15 12:49:53.574998 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 579/1186] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:53 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1749 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:54.158047 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e8decf43-422d-4a2f-b2d9-194799aeff36 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:54.159413 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e8decf43-422d-4a2f-b2d9-194799aeff36 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 2d63a34d-c889-4e35-8f01-d574369c19ba] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:54.165990 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e8decf43-422d-4a2f-b2d9-194799aeff36 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:54.166438 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e8decf43-422d-4a2f-b2d9-194799aeff36 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:54.167512 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e8decf43-422d-4a2f-b2d9-194799aeff36 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:54.167946 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e8decf43-422d-4a2f-b2d9-194799aeff36 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:54.313266 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e8decf43-422d-4a2f-b2d9-194799aeff36 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:54.320588 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e8decf43-422d-4a2f-b2d9-194799aeff36 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba" status: 200 len: 1266 microversion: 2.1 time: 0.166805 Nov 15 12:49:54.321144 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 608/1187] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:54 2021] GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:54.593606 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-ba0a60e6-fe89-467c-a25e-a9b5d198af53 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:54.594166 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-ba0a60e6-fe89-467c-a25e-a9b5d198af53 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:54.600566 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ba0a60e6-fe89-467c-a25e-a9b5d198af53 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:54.601006 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ba0a60e6-fe89-467c-a25e-a9b5d198af53 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:54.601770 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ba0a60e6-fe89-467c-a25e-a9b5d198af53 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:54.602197 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ba0a60e6-fe89-467c-a25e-a9b5d198af53 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:54.747284 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-ba0a60e6-fe89-467c-a25e-a9b5d198af53 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:54.755284 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-ba0a60e6-fe89-467c-a25e-a9b5d198af53 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1754 microversion: 2.1 time: 0.167638 Nov 15 12:49:54.755855 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 580/1188] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:54 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:55.188940 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [req-c76b64d2-6932-4dfe-9ec6-2cd1ded02823 req-f65d5d88-52ee-4c9a-bd86-995241aeb96d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d63a34d-c889-4e35-8f01-d574369c19ba", "name": "network-vif-plugged", "status": "completed", "tag": "078b27cb-8ab0-41e8-b3d0-544340291443"}]} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:49:55.190537 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:49:55.190537 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: warnings.warn(msg) Nov 15 12:49:55.197599 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-c76b64d2-6932-4dfe-9ec6-2cd1ded02823 req-f65d5d88-52ee-4c9a-bd86-995241aeb96d service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:55.198036 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-c76b64d2-6932-4dfe-9ec6-2cd1ded02823 req-f65d5d88-52ee-4c9a-bd86-995241aeb96d service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:55.213894 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.compute.server_external_events [req-c76b64d2-6932-4dfe-9ec6-2cd1ded02823 req-f65d5d88-52ee-4c9a-bd86-995241aeb96d service nova] Creating event network-vif-plugged:078b27cb-8ab0-41e8-b3d0-544340291443 for instance 2d63a34d-c889-4e35-8f01-d574369c19ba on hv-cinder-68088 Nov 15 12:49:55.218696 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [req-c76b64d2-6932-4dfe-9ec6-2cd1ded02823 req-f65d5d88-52ee-4c9a-bd86-995241aeb96d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033449 Nov 15 12:49:55.219329 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 609/1189] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:49:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:49:55.336712 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-cf288617-243f-46d2-a474-c63b80a2f4ee tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:55.337960 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-cf288617-243f-46d2-a474-c63b80a2f4ee tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 2d63a34d-c889-4e35-8f01-d574369c19ba] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:55.344363 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-cf288617-243f-46d2-a474-c63b80a2f4ee tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:55.344809 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-cf288617-243f-46d2-a474-c63b80a2f4ee tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:55.345588 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-cf288617-243f-46d2-a474-c63b80a2f4ee tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:55.346020 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-cf288617-243f-46d2-a474-c63b80a2f4ee tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:55.497904 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-cf288617-243f-46d2-a474-c63b80a2f4ee tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:55.505270 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-cf288617-243f-46d2-a474-c63b80a2f4ee tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba" status: 200 len: 1266 microversion: 2.1 time: 0.172198 Nov 15 12:49:55.505779 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 581/1190] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:55 2021] GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:55.773912 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-9d0b131b-e64d-400b-bef8-9aedabef17c5 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:55.774603 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-9d0b131b-e64d-400b-bef8-9aedabef17c5 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:55.781817 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9d0b131b-e64d-400b-bef8-9aedabef17c5 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:55.782265 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9d0b131b-e64d-400b-bef8-9aedabef17c5 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:55.783068 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9d0b131b-e64d-400b-bef8-9aedabef17c5 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:55.783501 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-9d0b131b-e64d-400b-bef8-9aedabef17c5 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:55.932065 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-9d0b131b-e64d-400b-bef8-9aedabef17c5 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:55.939886 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-9d0b131b-e64d-400b-bef8-9aedabef17c5 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1754 microversion: 2.1 time: 0.170452 Nov 15 12:49:55.940448 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 610/1191] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:55 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:56.523192 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-4069c715-e954-45c5-9e90-65d6861324c4 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:56.523732 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-4069c715-e954-45c5-9e90-65d6861324c4 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 2d63a34d-c889-4e35-8f01-d574369c19ba] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:56.530515 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4069c715-e954-45c5-9e90-65d6861324c4 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:56.530993 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4069c715-e954-45c5-9e90-65d6861324c4 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:56.531772 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4069c715-e954-45c5-9e90-65d6861324c4 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:56.532195 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-4069c715-e954-45c5-9e90-65d6861324c4 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:56.678457 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-4069c715-e954-45c5-9e90-65d6861324c4 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:56.688024 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-4069c715-e954-45c5-9e90-65d6861324c4 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba" status: 200 len: 1266 microversion: 2.1 time: 0.168511 Nov 15 12:49:56.688609 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 582/1192] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:56 2021] GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:56.957222 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-7b62ab33-870b-4291-ad95-b5792c1f67d0 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:56.957827 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-7b62ab33-870b-4291-ad95-b5792c1f67d0 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:56.964150 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7b62ab33-870b-4291-ad95-b5792c1f67d0 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:56.964602 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7b62ab33-870b-4291-ad95-b5792c1f67d0 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:56.965388 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7b62ab33-870b-4291-ad95-b5792c1f67d0 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:56.965799 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-7b62ab33-870b-4291-ad95-b5792c1f67d0 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:57.111413 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-7b62ab33-870b-4291-ad95-b5792c1f67d0 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:57.119774 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-7b62ab33-870b-4291-ad95-b5792c1f67d0 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1754 microversion: 2.1 time: 0.166258 Nov 15 12:49:57.120331 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 611/1193] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:56 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:57.705390 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-ca405409-21d0-4b19-b85c-c03638441501 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:57.705973 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-ca405409-21d0-4b19-b85c-c03638441501 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 2d63a34d-c889-4e35-8f01-d574369c19ba] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:57.712839 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ca405409-21d0-4b19-b85c-c03638441501 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:57.713421 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ca405409-21d0-4b19-b85c-c03638441501 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:57.714185 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ca405409-21d0-4b19-b85c-c03638441501 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:57.714609 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ca405409-21d0-4b19-b85c-c03638441501 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:57.845506 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-ca405409-21d0-4b19-b85c-c03638441501 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:57.853274 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-ca405409-21d0-4b19-b85c-c03638441501 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba" status: 200 len: 1453 microversion: 2.1 time: 0.151055 Nov 15 12:49:57.853989 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 583/1194] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:57 2021] GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:57.869534 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-177238ee-8198-4ef9-94c4-cc5e80879760 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:57.870139 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-177238ee-8198-4ef9-94c4-cc5e80879760 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 2d63a34d-c889-4e35-8f01-d574369c19ba] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:57.875982 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-177238ee-8198-4ef9-94c4-cc5e80879760 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:57.876425 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-177238ee-8198-4ef9-94c4-cc5e80879760 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:57.877194 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-177238ee-8198-4ef9-94c4-cc5e80879760 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:57.877625 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-177238ee-8198-4ef9-94c4-cc5e80879760 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:58.020781 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-177238ee-8198-4ef9-94c4-cc5e80879760 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:58.028556 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-177238ee-8198-4ef9-94c4-cc5e80879760 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba" status: 200 len: 1453 microversion: 2.1 time: 0.163280 Nov 15 12:49:58.029113 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 612/1195] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:57 2021] GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:58.137076 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-a3c80457-1f48-4f50-84ad-a2135d5f79ce tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:58.137895 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-a3c80457-1f48-4f50-84ad-a2135d5f79ce tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:58.143786 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a3c80457-1f48-4f50-84ad-a2135d5f79ce tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:58.144231 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a3c80457-1f48-4f50-84ad-a2135d5f79ce tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:58.144998 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a3c80457-1f48-4f50-84ad-a2135d5f79ce tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:58.145431 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-a3c80457-1f48-4f50-84ad-a2135d5f79ce tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:58.379016 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-a3c80457-1f48-4f50-84ad-a2135d5f79ce tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:58.387753 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-a3c80457-1f48-4f50-84ad-a2135d5f79ce tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1754 microversion: 2.1 time: 0.254590 Nov 15 12:49:58.388337 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 584/1196] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:58 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1754 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:49:59.405316 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e8a0c5cf-5bdb-4d76-92be-d679f42887d3 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:49:59.406072 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e8a0c5cf-5bdb-4d76-92be-d679f42887d3 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:49:59.412251 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e8a0c5cf-5bdb-4d76-92be-d679f42887d3 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:59.412701 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e8a0c5cf-5bdb-4d76-92be-d679f42887d3 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:59.413479 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e8a0c5cf-5bdb-4d76-92be-d679f42887d3 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:59.413923 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e8a0c5cf-5bdb-4d76-92be-d679f42887d3 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:59.718824 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-e8a0c5cf-5bdb-4d76-92be-d679f42887d3 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:49:59.726719 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e8a0c5cf-5bdb-4d76-92be-d679f42887d3 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1754 microversion: 2.1 time: 0.325136 Nov 15 12:49:59.727329 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 613/1197] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:49:59 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1754 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:49:59.806165 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-1d089129-34d7-4135-8656-e61eb174c908 req-aec89e34-8239-4111-aa6b-a9f0aaf3ee47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d63a34d-c889-4e35-8f01-d574369c19ba", "tag": "078b27cb-8ab0-41e8-b3d0-544340291443"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:49:59.807730 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:49:59.807730 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:49:59.815299 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-1d089129-34d7-4135-8656-e61eb174c908 req-aec89e34-8239-4111-aa6b-a9f0aaf3ee47 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:49:59.815664 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-1d089129-34d7-4135-8656-e61eb174c908 req-aec89e34-8239-4111-aa6b-a9f0aaf3ee47 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:49:59.827388 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-1d089129-34d7-4135-8656-e61eb174c908 req-aec89e34-8239-4111-aa6b-a9f0aaf3ee47 service nova] Creating event network-changed:078b27cb-8ab0-41e8-b3d0-544340291443 for instance 2d63a34d-c889-4e35-8f01-d574369c19ba on hv-cinder-68088 Nov 15 12:49:59.832335 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-1d089129-34d7-4135-8656-e61eb174c908 req-aec89e34-8239-4111-aa6b-a9f0aaf3ee47 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029783 Nov 15 12:49:59.833142 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 585/1198] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:49:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:50:00.745488 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-caaa22bb-236d-4c61-ac87-41fcbc7fabf9 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:50:00.746072 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-caaa22bb-236d-4c61-ac87-41fcbc7fabf9 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:50:00.752694 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-caaa22bb-236d-4c61-ac87-41fcbc7fabf9 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:50:00.753136 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-caaa22bb-236d-4c61-ac87-41fcbc7fabf9 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:50:00.753917 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-caaa22bb-236d-4c61-ac87-41fcbc7fabf9 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:50:00.754344 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-caaa22bb-236d-4c61-ac87-41fcbc7fabf9 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:50:00.902452 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-caaa22bb-236d-4c61-ac87-41fcbc7fabf9 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:50:00.910319 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-caaa22bb-236d-4c61-ac87-41fcbc7fabf9 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1754 microversion: 2.1 time: 0.169253 Nov 15 12:50:00.911016 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 614/1199] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:50:00 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:50:01.930076 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-61a319f1-9439-44b5-9e06-b1cc0a8bf675 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:50:01.931281 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-61a319f1-9439-44b5-9e06-b1cc0a8bf675 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:50:01.937616 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-61a319f1-9439-44b5-9e06-b1cc0a8bf675 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:50:01.938053 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-61a319f1-9439-44b5-9e06-b1cc0a8bf675 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:50:01.938832 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-61a319f1-9439-44b5-9e06-b1cc0a8bf675 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:50:01.939257 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-61a319f1-9439-44b5-9e06-b1cc0a8bf675 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:50:02.085660 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-61a319f1-9439-44b5-9e06-b1cc0a8bf675 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:50:02.094141 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-61a319f1-9439-44b5-9e06-b1cc0a8bf675 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1754 microversion: 2.1 time: 0.168511 Nov 15 12:50:02.094712 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 586/1200] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:50:01 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:50:03.111615 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-5e1991e7-6a53-476a-af85-3a76ba8d6c82 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:50:03.112165 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-5e1991e7-6a53-476a-af85-3a76ba8d6c82 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:50:03.118460 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5e1991e7-6a53-476a-af85-3a76ba8d6c82 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:50:03.118953 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5e1991e7-6a53-476a-af85-3a76ba8d6c82 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:50:03.119766 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5e1991e7-6a53-476a-af85-3a76ba8d6c82 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:50:03.120196 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-5e1991e7-6a53-476a-af85-3a76ba8d6c82 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:50:03.262707 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-5e1991e7-6a53-476a-af85-3a76ba8d6c82 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:50:03.270494 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-5e1991e7-6a53-476a-af85-3a76ba8d6c82 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1754 microversion: 2.1 time: 0.162654 Nov 15 12:50:03.271095 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 615/1201] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:50:03 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:50:04.287875 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-143c99ce-f0ca-4eb4-b11c-28741be0623c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:50:04.288479 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-143c99ce-f0ca-4eb4-b11c-28741be0623c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:50:04.295805 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-143c99ce-f0ca-4eb4-b11c-28741be0623c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:50:04.296245 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-143c99ce-f0ca-4eb4-b11c-28741be0623c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:50:04.297016 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-143c99ce-f0ca-4eb4-b11c-28741be0623c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:50:04.297445 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-143c99ce-f0ca-4eb4-b11c-28741be0623c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:50:04.442982 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-143c99ce-f0ca-4eb4-b11c-28741be0623c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:50:04.451699 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-143c99ce-f0ca-4eb4-b11c-28741be0623c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1754 microversion: 2.1 time: 0.167378 Nov 15 12:50:04.452205 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 587/1202] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:50:04 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:50:05.469088 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-ec2fa4db-7d9f-4359-a13e-80026322595d tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:50:05.469618 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-ec2fa4db-7d9f-4359-a13e-80026322595d tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:50:05.475908 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ec2fa4db-7d9f-4359-a13e-80026322595d tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:50:05.476359 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ec2fa4db-7d9f-4359-a13e-80026322595d tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:50:05.477135 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ec2fa4db-7d9f-4359-a13e-80026322595d tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:50:05.477591 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-ec2fa4db-7d9f-4359-a13e-80026322595d tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:50:05.630099 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-ec2fa4db-7d9f-4359-a13e-80026322595d tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:50:05.637915 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-ec2fa4db-7d9f-4359-a13e-80026322595d tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1757 microversion: 2.1 time: 0.172633 Nov 15 12:50:05.638488 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 616/1203] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:50:05 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:50:24.674361 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 15 12:50:24.675300 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: Mon Nov 15 12:50:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 15 12:50:38.269325 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-c6b55f4d-ab13-4d0c-b3dc-6bd6a82911da tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-950017187"}} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:50:38.269935 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-c6b55f4d-ab13-4d0c-b3dc-6bd6a82911da tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:50:38.275881 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c6b55f4d-ab13-4d0c-b3dc-6bd6a82911da tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:50:38.276322 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c6b55f4d-ab13-4d0c-b3dc-6bd6a82911da tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:50:38.277085 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c6b55f4d-ab13-4d0c-b3dc-6bd6a82911da tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:50:38.277513 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-c6b55f4d-ab13-4d0c-b3dc-6bd6a82911da tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:50:38.408477 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.network.security_group_api [None req-c6b55f4d-ab13-4d0c-b3dc-6bd6a82911da tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Removing security group bff84037-40b7-4670-a60a-d1d21d677b3c from port 6c4dacb1-ba9b-41c5-9682-a84812cc49d9 Nov 15 12:50:39.023518 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-c6b55f4d-ab13-4d0c-b3dc-6bd6a82911da tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "POST /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df/action" status: 202 len: 0 microversion: 2.1 time: 0.758050 Nov 15 12:50:39.029738 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 588/1204] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Nov 15 12:50:38 2021] POST /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df/action => generated 0 bytes in 764 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:50:39.129214 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [req-b699184f-985a-4640-a202-3878a4780f44 req-c4ba8015-e179-4971-b63b-d1c00dd60820 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b384711-646f-4693-b6da-0c50ca5d70df", "tag": "6c4dacb1-ba9b-41c5-9682-a84812cc49d9"}]} {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:50:39.132094 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:50:39.132094 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: warnings.warn(msg) Nov 15 12:50:39.141024 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-b699184f-985a-4640-a202-3878a4780f44 req-c4ba8015-e179-4971-b63b-d1c00dd60820 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:50:39.141465 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [req-b699184f-985a-4640-a202-3878a4780f44 req-c4ba8015-e179-4971-b63b-d1c00dd60820 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:50:39.152838 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.compute.server_external_events [req-b699184f-985a-4640-a202-3878a4780f44 req-c4ba8015-e179-4971-b63b-d1c00dd60820 service nova] Creating event network-changed:6c4dacb1-ba9b-41c5-9682-a84812cc49d9 for instance 5b384711-646f-4693-b6da-0c50ca5d70df on hv-cinder-68088 Nov 15 12:50:39.158481 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [req-b699184f-985a-4640-a202-3878a4780f44 req-c4ba8015-e179-4971-b63b-d1c00dd60820 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127053 Nov 15 12:50:39.160007 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 617/1205] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:50:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:50:40.157791 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-810578f0-ac95-45d4-8f61-539adf234072 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:50:40.158320 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-810578f0-ac95-45d4-8f61-539adf234072 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:50:40.164299 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-810578f0-ac95-45d4-8f61-539adf234072 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:50:40.165291 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-810578f0-ac95-45d4-8f61-539adf234072 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:50:40.166162 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-810578f0-ac95-45d4-8f61-539adf234072 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:50:40.166586 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-810578f0-ac95-45d4-8f61-539adf234072 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:50:40.251336 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.objects.instance [None req-810578f0-ac95-45d4-8f61-539adf234072 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lazy-loading 'services' on Instance uuid 5b384711-646f-4693-b6da-0c50ca5d70df {{(pid=122568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 15 12:50:40.328074 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-810578f0-ac95-45d4-8f61-539adf234072 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df/os-volume_attachments/ddbaf25a-997c-4ee2-8d07-91614a2c1867" status: 202 len: 0 microversion: 2.1 time: 0.174459 Nov 15 12:50:40.328881 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 589/1206] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Nov 15 12:50:40 2021] DELETE /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df/os-volume_attachments/ddbaf25a-997c-4ee2-8d07-91614a2c1867 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:50:40.340984 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-1b29f328-337b-4bec-a1d8-a8df57a64f70 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:50:40.342912 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-1b29f328-337b-4bec-a1d8-a8df57a64f70 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:50:40.351687 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1b29f328-337b-4bec-a1d8-a8df57a64f70 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:50:40.352194 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1b29f328-337b-4bec-a1d8-a8df57a64f70 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:50:40.353203 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1b29f328-337b-4bec-a1d8-a8df57a64f70 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:50:40.353667 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-1b29f328-337b-4bec-a1d8-a8df57a64f70 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:50:40.386330 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-1b29f328-337b-4bec-a1d8-a8df57a64f70 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051792 Nov 15 12:50:40.387681 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 618/1207] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Nov 15 12:50:40 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:50:41.176655 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-c51ad048-9e2c-49c4-bba9-9baf7f4e3caf req-de1e7025-c29f-4dd8-8fe5-a8e0ed05d725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b384711-646f-4693-b6da-0c50ca5d70df", "tag": "6c4dacb1-ba9b-41c5-9682-a84812cc49d9"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:50:41.178356 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:50:41.178356 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:50:41.186340 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-c51ad048-9e2c-49c4-bba9-9baf7f4e3caf req-de1e7025-c29f-4dd8-8fe5-a8e0ed05d725 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:50:41.186812 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-c51ad048-9e2c-49c4-bba9-9baf7f4e3caf req-de1e7025-c29f-4dd8-8fe5-a8e0ed05d725 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:50:41.198570 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-c51ad048-9e2c-49c4-bba9-9baf7f4e3caf req-de1e7025-c29f-4dd8-8fe5-a8e0ed05d725 service nova] Creating event network-changed:6c4dacb1-ba9b-41c5-9682-a84812cc49d9 for instance 5b384711-646f-4693-b6da-0c50ca5d70df on hv-cinder-68088 Nov 15 12:50:41.207125 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-c51ad048-9e2c-49c4-bba9-9baf7f4e3caf req-de1e7025-c29f-4dd8-8fe5-a8e0ed05d725 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035790 Nov 15 12:50:41.208317 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 590/1208] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:50:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:50:41.397442 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-0ee5625a-c7d7-491b-a5aa-42c139325f4b tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:50:41.399844 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-0ee5625a-c7d7-491b-a5aa-42c139325f4b tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:50:41.405746 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0ee5625a-c7d7-491b-a5aa-42c139325f4b tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:50:41.406170 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0ee5625a-c7d7-491b-a5aa-42c139325f4b tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:50:41.407102 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0ee5625a-c7d7-491b-a5aa-42c139325f4b tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:50:41.407706 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0ee5625a-c7d7-491b-a5aa-42c139325f4b tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:50:41.438278 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-0ee5625a-c7d7-491b-a5aa-42c139325f4b tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044521 Nov 15 12:50:41.439244 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 619/1209] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Nov 15 12:50:41 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 15 12:50:41.449124 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-5b310d62-e293-457a-a6b0-75098415e689 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:50:41.449692 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-5b310d62-e293-457a-a6b0-75098415e689 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:50:41.456178 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5b310d62-e293-457a-a6b0-75098415e689 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:50:41.456696 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5b310d62-e293-457a-a6b0-75098415e689 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:50:41.457485 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5b310d62-e293-457a-a6b0-75098415e689 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:50:41.457911 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-5b310d62-e293-457a-a6b0-75098415e689 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:50:41.530973 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.wsgi [None req-5b310d62-e293-457a-a6b0-75098415e689 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] HTTP exception thrown: Instance 5b384711-646f-4693-b6da-0c50ca5d70df is not attached to volume ddbaf25a-997c-4ee2-8d07-91614a2c1867 Nov 15 12:50:41.531575 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-5b310d62-e293-457a-a6b0-75098415e689 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Returning 404 to user: Instance 5b384711-646f-4693-b6da-0c50ca5d70df is not attached to volume ddbaf25a-997c-4ee2-8d07-91614a2c1867 {{(pid=122568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:50:41.532412 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-5b310d62-e293-457a-a6b0-75098415e689 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df/os-volume_attachments/ddbaf25a-997c-4ee2-8d07-91614a2c1867" status: 404 len: 154 microversion: 2.1 time: 0.087567 Nov 15 12:50:41.532967 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 591/1210] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Nov 15 12:50:41 2021] DELETE /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df/os-volume_attachments/ddbaf25a-997c-4ee2-8d07-91614a2c1867 => generated 154 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 15 12:50:42.666188 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-0f0cf282-c2cc-4564-8f53-cf55029168f9 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:50:42.667010 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-0f0cf282-c2cc-4564-8f53-cf55029168f9 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:50:42.673157 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0f0cf282-c2cc-4564-8f53-cf55029168f9 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:50:42.673603 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0f0cf282-c2cc-4564-8f53-cf55029168f9 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:50:42.674373 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0f0cf282-c2cc-4564-8f53-cf55029168f9 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:50:42.674829 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-0f0cf282-c2cc-4564-8f53-cf55029168f9 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:50:42.699952 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-0f0cf282-c2cc-4564-8f53-cf55029168f9 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Going to try to terminate instance {{(pid=122567) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 15 12:50:42.780343 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-0f0cf282-c2cc-4564-8f53-cf55029168f9 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 204 len: 0 microversion: 2.1 time: 0.118017 Nov 15 12:50:42.781160 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 620/1211] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Nov 15 12:50:42 2021] DELETE /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 15 12:50:42.789182 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-9f0811ae-55df-48dd-85e6-248c103ac05c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:50:42.790629 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-9f0811ae-55df-48dd-85e6-248c103ac05c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:50:42.797573 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9f0811ae-55df-48dd-85e6-248c103ac05c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:50:42.798027 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9f0811ae-55df-48dd-85e6-248c103ac05c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:50:42.798836 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9f0811ae-55df-48dd-85e6-248c103ac05c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:50:42.799268 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-9f0811ae-55df-48dd-85e6-248c103ac05c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:50:42.937786 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-9f0811ae-55df-48dd-85e6-248c103ac05c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:50:42.945063 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-9f0811ae-55df-48dd-85e6-248c103ac05c tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1552 microversion: 2.1 time: 0.159892 Nov 15 12:50:42.945654 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 592/1212] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:50:42 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:50:43.964157 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-c22e14b6-aaa8-42f5-9262-e86d2612bd46 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:50:43.964862 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-c22e14b6-aaa8-42f5-9262-e86d2612bd46 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:50:43.971226 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c22e14b6-aaa8-42f5-9262-e86d2612bd46 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:50:43.971679 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c22e14b6-aaa8-42f5-9262-e86d2612bd46 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:50:43.972457 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c22e14b6-aaa8-42f5-9262-e86d2612bd46 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:50:43.972893 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-c22e14b6-aaa8-42f5-9262-e86d2612bd46 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:50:44.111837 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-c22e14b6-aaa8-42f5-9262-e86d2612bd46 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:50:44.120173 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-c22e14b6-aaa8-42f5-9262-e86d2612bd46 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1552 microversion: 2.1 time: 0.160370 Nov 15 12:50:44.120948 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 621/1213] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:50:43 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:50:45.137669 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-8b145715-4418-4d45-9860-213ba7720684 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:50:45.138508 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-8b145715-4418-4d45-9860-213ba7720684 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:50:45.144576 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8b145715-4418-4d45-9860-213ba7720684 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:50:45.145019 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8b145715-4418-4d45-9860-213ba7720684 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:50:45.145783 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8b145715-4418-4d45-9860-213ba7720684 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:50:45.146206 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-8b145715-4418-4d45-9860-213ba7720684 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:50:45.206203 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-664b06f3-88ea-4728-8fdd-026e8b374e6e req-afc6aacd-06fc-4dc8-be84-221cd0e1f645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b384711-646f-4693-b6da-0c50ca5d70df", "name": "network-vif-deleted", "tag": "6c4dacb1-ba9b-41c5-9682-a84812cc49d9"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:50:45.208414 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:50:45.208414 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:50:45.215438 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-664b06f3-88ea-4728-8fdd-026e8b374e6e req-afc6aacd-06fc-4dc8-be84-221cd0e1f645 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:50:45.215875 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-664b06f3-88ea-4728-8fdd-026e8b374e6e req-afc6aacd-06fc-4dc8-be84-221cd0e1f645 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:50:45.218810 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-8b145715-4418-4d45-9860-213ba7720684 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c2ab811f854cb18cbe42aae9a17c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb31629f759d420e90dae2332b8cf2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:50:45.227393 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-664b06f3-88ea-4728-8fdd-026e8b374e6e req-afc6aacd-06fc-4dc8-be84-221cd0e1f645 service nova] Creating event network-vif-deleted:6c4dacb1-ba9b-41c5-9682-a84812cc49d9 for instance 5b384711-646f-4693-b6da-0c50ca5d70df on hv-cinder-68088 Nov 15 12:50:45.229832 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-8b145715-4418-4d45-9860-213ba7720684 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 200 len: 1510 microversion: 2.1 time: 0.095679 Nov 15 12:50:45.231035 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 622/1214] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:50:45 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 1510 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 15 12:50:45.235733 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-664b06f3-88ea-4728-8fdd-026e8b374e6e req-afc6aacd-06fc-4dc8-be84-221cd0e1f645 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104235 Nov 15 12:50:45.236742 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 593/1215] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:50:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:50:46.247897 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-2effc06a-25f1-4057-b2c8-002aec0b1d34 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:50:46.248508 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-2effc06a-25f1-4057-b2c8-002aec0b1d34 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] [instance: 5b384711-646f-4693-b6da-0c50ca5d70df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:50:46.254825 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2effc06a-25f1-4057-b2c8-002aec0b1d34 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:50:46.255274 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2effc06a-25f1-4057-b2c8-002aec0b1d34 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:50:46.256046 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2effc06a-25f1-4057-b2c8-002aec0b1d34 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:50:46.256475 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-2effc06a-25f1-4057-b2c8-002aec0b1d34 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:50:46.269863 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.wsgi [None req-2effc06a-25f1-4057-b2c8-002aec0b1d34 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] HTTP exception thrown: Instance 5b384711-646f-4693-b6da-0c50ca5d70df could not be found. Nov 15 12:50:46.270453 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-2effc06a-25f1-4057-b2c8-002aec0b1d34 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Returning 404 to user: Instance 5b384711-646f-4693-b6da-0c50ca5d70df could not be found. {{(pid=122567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:50:46.271311 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-2effc06a-25f1-4057-b2c8-002aec0b1d34 tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df" status: 404 len: 111 microversion: 2.1 time: 0.027163 Nov 15 12:50:46.271855 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 623/1216] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:50:46 2021] GET /compute/v2.1/servers/5b384711-646f-4693-b6da-0c50ca5d70df => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 15 12:50:46.281374 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-2713b01b-4b03-4283-a3e9-c69d1dcdfa8e tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] Calling method '.version_select at 0x7f131b24dd30>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:50:46.299173 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-2713b01b-4b03-4283-a3e9-c69d1dcdfa8e tempest-TestMinimumBasicScenario-664258123 tempest-TestMinimumBasicScenario-664258123-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-127766071" status: 202 len: 0 microversion: 2.1 time: 0.022091 Nov 15 12:50:46.299733 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 594/1217] 10.222.0.43 () {58 vars in 1268 bytes} [Mon Nov 15 12:50:46 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-127766071 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:51:42.564154 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-1bd75cc1-4e25-45d9-a865-03afac97811a req-eef04e2b-37c0-403c-99ea-6b6ff37a407c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d63a34d-c889-4e35-8f01-d574369c19ba", "tag": "078b27cb-8ab0-41e8-b3d0-544340291443"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:51:42.565641 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:51:42.565641 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:51:42.570393 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-6b868107-94d2-4c95-8d46-5f6eea2b1dce tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:51:42.571779 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-6b868107-94d2-4c95-8d46-5f6eea2b1dce tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 2d63a34d-c889-4e35-8f01-d574369c19ba] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:51:42.574362 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-1bd75cc1-4e25-45d9-a865-03afac97811a req-eef04e2b-37c0-403c-99ea-6b6ff37a407c service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:51:42.574789 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-1bd75cc1-4e25-45d9-a865-03afac97811a req-eef04e2b-37c0-403c-99ea-6b6ff37a407c service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:51:42.578061 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6b868107-94d2-4c95-8d46-5f6eea2b1dce tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:51:42.578512 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6b868107-94d2-4c95-8d46-5f6eea2b1dce tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:51:42.579334 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6b868107-94d2-4c95-8d46-5f6eea2b1dce tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:51:42.579992 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-6b868107-94d2-4c95-8d46-5f6eea2b1dce tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:51:42.586877 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-1bd75cc1-4e25-45d9-a865-03afac97811a req-eef04e2b-37c0-403c-99ea-6b6ff37a407c service nova] Creating event network-changed:078b27cb-8ab0-41e8-b3d0-544340291443 for instance 2d63a34d-c889-4e35-8f01-d574369c19ba on hv-cinder-68088 Nov 15 12:51:42.592429 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-1bd75cc1-4e25-45d9-a865-03afac97811a req-eef04e2b-37c0-403c-99ea-6b6ff37a407c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032547 Nov 15 12:51:42.593241 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 595/1218] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:51:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:51:42.607083 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-6b868107-94d2-4c95-8d46-5f6eea2b1dce tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 2d63a34d-c889-4e35-8f01-d574369c19ba] Going to try to terminate instance {{(pid=122567) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 15 12:51:42.689342 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-6b868107-94d2-4c95-8d46-5f6eea2b1dce tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba" status: 204 len: 0 microversion: 2.1 time: 0.131523 Nov 15 12:51:42.689908 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 624/1219] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Nov 15 12:51:42 2021] DELETE /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 15 12:51:42.699731 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-569a5dcb-db6d-4997-a2d1-0f10fb20dccb tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:51:42.700444 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-569a5dcb-db6d-4997-a2d1-0f10fb20dccb tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 2d63a34d-c889-4e35-8f01-d574369c19ba] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:51:42.707103 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-569a5dcb-db6d-4997-a2d1-0f10fb20dccb tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:51:42.707750 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-569a5dcb-db6d-4997-a2d1-0f10fb20dccb tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:51:42.708332 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-569a5dcb-db6d-4997-a2d1-0f10fb20dccb tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:51:42.708760 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-569a5dcb-db6d-4997-a2d1-0f10fb20dccb tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:51:42.864289 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-569a5dcb-db6d-4997-a2d1-0f10fb20dccb tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:51:42.874125 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-569a5dcb-db6d-4997-a2d1-0f10fb20dccb tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba" status: 200 len: 1578 microversion: 2.1 time: 0.179262 Nov 15 12:51:42.885425 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 596/1220] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:51:42 2021] GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba => generated 1578 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:51:43.893405 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-832c3f16-0b79-43d6-ad1b-e4ef723db26c tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:51:43.894051 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-832c3f16-0b79-43d6-ad1b-e4ef723db26c tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 2d63a34d-c889-4e35-8f01-d574369c19ba] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:51:43.901363 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-832c3f16-0b79-43d6-ad1b-e4ef723db26c tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:51:43.901815 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-832c3f16-0b79-43d6-ad1b-e4ef723db26c tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:51:43.902601 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-832c3f16-0b79-43d6-ad1b-e4ef723db26c tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:51:43.903065 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-832c3f16-0b79-43d6-ad1b-e4ef723db26c tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:51:44.045393 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-832c3f16-0b79-43d6-ad1b-e4ef723db26c tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:51:44.052787 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-832c3f16-0b79-43d6-ad1b-e4ef723db26c tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba" status: 200 len: 1459 microversion: 2.1 time: 0.163532 Nov 15 12:51:44.053361 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 625/1221] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:51:43 2021] GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba => generated 1459 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:51:44.911921 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-ae651293-3032-430c-a8af-53815cf32459 req-af2eba4d-63da-4669-b243-092e7fb2c9b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d63a34d-c889-4e35-8f01-d574369c19ba", "name": "network-vif-deleted", "tag": "078b27cb-8ab0-41e8-b3d0-544340291443"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:51:44.913553 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:51:44.913553 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:51:44.921746 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-ae651293-3032-430c-a8af-53815cf32459 req-af2eba4d-63da-4669-b243-092e7fb2c9b2 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:51:44.922179 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-ae651293-3032-430c-a8af-53815cf32459 req-af2eba4d-63da-4669-b243-092e7fb2c9b2 service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:51:44.933840 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-ae651293-3032-430c-a8af-53815cf32459 req-af2eba4d-63da-4669-b243-092e7fb2c9b2 service nova] Creating event network-vif-deleted:078b27cb-8ab0-41e8-b3d0-544340291443 for instance 2d63a34d-c889-4e35-8f01-d574369c19ba on hv-cinder-68088 Nov 15 12:51:44.938547 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-ae651293-3032-430c-a8af-53815cf32459 req-af2eba4d-63da-4669-b243-092e7fb2c9b2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030201 Nov 15 12:51:44.939176 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 597/1222] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:51:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:51:45.070630 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-484d59e2-6d41-4059-91fd-b99d98ca9b42 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:51:45.071470 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-484d59e2-6d41-4059-91fd-b99d98ca9b42 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 2d63a34d-c889-4e35-8f01-d574369c19ba] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:51:45.077957 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-484d59e2-6d41-4059-91fd-b99d98ca9b42 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:51:45.078488 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-484d59e2-6d41-4059-91fd-b99d98ca9b42 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:51:45.079393 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-484d59e2-6d41-4059-91fd-b99d98ca9b42 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:51:45.079903 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-484d59e2-6d41-4059-91fd-b99d98ca9b42 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:51:45.139469 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-484d59e2-6d41-4059-91fd-b99d98ca9b42 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:51:45.146786 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-484d59e2-6d41-4059-91fd-b99d98ca9b42 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba" status: 200 len: 1225 microversion: 2.1 time: 0.079837 Nov 15 12:51:45.147559 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 626/1223] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:51:45 2021] GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:51:46.166012 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-ef67b50c-cc32-44de-826b-e226cb907abc tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:51:46.167017 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-ef67b50c-cc32-44de-826b-e226cb907abc tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 2d63a34d-c889-4e35-8f01-d574369c19ba] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:51:46.173180 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ef67b50c-cc32-44de-826b-e226cb907abc tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:51:46.173619 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ef67b50c-cc32-44de-826b-e226cb907abc tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:51:46.174392 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ef67b50c-cc32-44de-826b-e226cb907abc tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:51:46.174852 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-ef67b50c-cc32-44de-826b-e226cb907abc tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:51:46.189023 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.wsgi [None req-ef67b50c-cc32-44de-826b-e226cb907abc tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] HTTP exception thrown: Instance 2d63a34d-c889-4e35-8f01-d574369c19ba could not be found. Nov 15 12:51:46.189806 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-ef67b50c-cc32-44de-826b-e226cb907abc tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Returning 404 to user: Instance 2d63a34d-c889-4e35-8f01-d574369c19ba could not be found. {{(pid=122568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:51:46.190677 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-ef67b50c-cc32-44de-826b-e226cb907abc tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba" status: 404 len: 111 microversion: 2.1 time: 0.029957 Nov 15 12:51:46.191275 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 598/1224] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:51:46 2021] GET /compute/v2.1/servers/2d63a34d-c889-4e35-8f01-d574369c19ba => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 15 12:51:49.653701 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-64d6769d-d5aa-4cab-9226-f59cf6b706cf tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:51:49.654221 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-64d6769d-d5aa-4cab-9226-f59cf6b706cf tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 012358cb-bdcf-4afc-b480-5399958e82df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:51:49.656244 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-3d480076-863f-497e-a6fe-634fe7c8629f req-86351408-b5a8-4693-a5fe-34c32b856b6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "012358cb-bdcf-4afc-b480-5399958e82df", "tag": "471bc66e-1316-423a-b9d0-fa99991998d4"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:51:49.657752 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:51:49.657752 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:51:49.660686 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-64d6769d-d5aa-4cab-9226-f59cf6b706cf tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:51:49.661215 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-64d6769d-d5aa-4cab-9226-f59cf6b706cf tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:51:49.662208 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-64d6769d-d5aa-4cab-9226-f59cf6b706cf tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:51:49.662730 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-64d6769d-d5aa-4cab-9226-f59cf6b706cf tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:51:49.665587 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-3d480076-863f-497e-a6fe-634fe7c8629f req-86351408-b5a8-4693-a5fe-34c32b856b6f service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:51:49.666025 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-3d480076-863f-497e-a6fe-634fe7c8629f req-86351408-b5a8-4693-a5fe-34c32b856b6f service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:51:49.677780 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-3d480076-863f-497e-a6fe-634fe7c8629f req-86351408-b5a8-4693-a5fe-34c32b856b6f service nova] Creating event network-changed:471bc66e-1316-423a-b9d0-fa99991998d4 for instance 012358cb-bdcf-4afc-b480-5399958e82df on hv-cinder-68088 Nov 15 12:51:49.683793 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-3d480076-863f-497e-a6fe-634fe7c8629f req-86351408-b5a8-4693-a5fe-34c32b856b6f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031158 Nov 15 12:51:49.684935 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 599/1225] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:51:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 15 12:51:49.692380 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-64d6769d-d5aa-4cab-9226-f59cf6b706cf tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 012358cb-bdcf-4afc-b480-5399958e82df] Going to try to terminate instance {{(pid=122567) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 15 12:51:49.785699 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-64d6769d-d5aa-4cab-9226-f59cf6b706cf tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "DELETE /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df" status: 204 len: 0 microversion: 2.1 time: 0.135628 Nov 15 12:51:49.790188 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 627/1226] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Nov 15 12:51:49 2021] DELETE /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 15 12:51:49.796520 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-0adbb175-24a2-479a-b9ed-189b6f4b4298 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:51:49.797310 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-0adbb175-24a2-479a-b9ed-189b6f4b4298 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 012358cb-bdcf-4afc-b480-5399958e82df] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:51:49.803702 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0adbb175-24a2-479a-b9ed-189b6f4b4298 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:51:49.804158 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0adbb175-24a2-479a-b9ed-189b6f4b4298 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:51:49.805039 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0adbb175-24a2-479a-b9ed-189b6f4b4298 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:51:49.805777 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-0adbb175-24a2-479a-b9ed-189b6f4b4298 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:51:49.952044 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.policy [None req-0adbb175-24a2-479a-b9ed-189b6f4b4298 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:51:49.963331 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-0adbb175-24a2-479a-b9ed-189b6f4b4298 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df" status: 200 len: 1579 microversion: 2.1 time: 0.170800 Nov 15 12:51:49.964619 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 600/1227] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:51:49 2021] GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df => generated 1579 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:51:50.981496 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-06d84439-2897-4217-9640-2a7225aa8858 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:51:50.982186 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-06d84439-2897-4217-9640-2a7225aa8858 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 012358cb-bdcf-4afc-b480-5399958e82df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:51:50.988233 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-06d84439-2897-4217-9640-2a7225aa8858 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:51:50.988679 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-06d84439-2897-4217-9640-2a7225aa8858 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:51:50.990199 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-06d84439-2897-4217-9640-2a7225aa8858 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:51:50.990913 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-06d84439-2897-4217-9640-2a7225aa8858 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:51:51.128708 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-06d84439-2897-4217-9640-2a7225aa8858 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:51:51.136811 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-06d84439-2897-4217-9640-2a7225aa8858 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df" status: 200 len: 1461 microversion: 2.1 time: 0.159809 Nov 15 12:51:51.137383 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 628/1228] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:51:50 2021] GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df => generated 1461 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:51:51.900543 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [req-4a848064-6d46-442c-954f-22663d236e85 req-414edb75-9d5f-454c-a067-5835070789fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "012358cb-bdcf-4afc-b480-5399958e82df", "name": "network-vif-deleted", "tag": "471bc66e-1316-423a-b9d0-fa99991998d4"}]} {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 15 12:51:51.902189 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 15 12:51:51.902189 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: warnings.warn(msg) Nov 15 12:51:51.909756 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-4a848064-6d46-442c-954f-22663d236e85 req-414edb75-9d5f-454c-a067-5835070789fe service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:51:51.910189 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [req-4a848064-6d46-442c-954f-22663d236e85 req-414edb75-9d5f-454c-a067-5835070789fe service nova] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:51:51.924211 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.compute.server_external_events [req-4a848064-6d46-442c-954f-22663d236e85 req-414edb75-9d5f-454c-a067-5835070789fe service nova] Creating event network-vif-deleted:471bc66e-1316-423a-b9d0-fa99991998d4 for instance 012358cb-bdcf-4afc-b480-5399958e82df on hv-cinder-68088 Nov 15 12:51:51.929214 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [req-4a848064-6d46-442c-954f-22663d236e85 req-414edb75-9d5f-454c-a067-5835070789fe service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032465 Nov 15 12:51:51.930591 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 601/1229] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Nov 15 12:51:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 15 12:51:52.153720 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-b8e21ba6-6f0f-4d14-a170-ee7bb590de1c tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:51:52.154310 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-b8e21ba6-6f0f-4d14-a170-ee7bb590de1c tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 012358cb-bdcf-4afc-b480-5399958e82df] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:51:52.160999 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b8e21ba6-6f0f-4d14-a170-ee7bb590de1c tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:51:52.161452 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b8e21ba6-6f0f-4d14-a170-ee7bb590de1c tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:51:52.162230 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b8e21ba6-6f0f-4d14-a170-ee7bb590de1c tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:51:52.162664 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-b8e21ba6-6f0f-4d14-a170-ee7bb590de1c tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:51:52.230103 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.policy [None req-b8e21ba6-6f0f-4d14-a170-ee7bb590de1c tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8f2a4f7c84026859778c12d6f7c35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78fedf356a24ea182428c85682330f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 15 12:51:52.239265 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-b8e21ba6-6f0f-4d14-a170-ee7bb590de1c tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df" status: 200 len: 1226 microversion: 2.1 time: 0.089404 Nov 15 12:51:52.240101 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 629/1230] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:51:52 2021] GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 15 12:51:53.256852 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-464dd326-72c5-49e8-8adb-a45a04d33db4 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:51:53.257537 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-464dd326-72c5-49e8-8adb-a45a04d33db4 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: 012358cb-bdcf-4afc-b480-5399958e82df] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:51:53.265505 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-464dd326-72c5-49e8-8adb-a45a04d33db4 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:51:53.265988 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-464dd326-72c5-49e8-8adb-a45a04d33db4 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:51:53.266797 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-464dd326-72c5-49e8-8adb-a45a04d33db4 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:51:53.267221 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-464dd326-72c5-49e8-8adb-a45a04d33db4 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:51:53.280555 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.wsgi [None req-464dd326-72c5-49e8-8adb-a45a04d33db4 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] HTTP exception thrown: Instance 012358cb-bdcf-4afc-b480-5399958e82df could not be found. Nov 15 12:51:53.281143 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-464dd326-72c5-49e8-8adb-a45a04d33db4 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Returning 404 to user: Instance 012358cb-bdcf-4afc-b480-5399958e82df could not be found. {{(pid=122568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:51:53.281965 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-464dd326-72c5-49e8-8adb-a45a04d33db4 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df" status: 404 len: 111 microversion: 2.1 time: 0.029732 Nov 15 12:51:53.282506 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 602/1231] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:51:53 2021] GET /compute/v2.1/servers/012358cb-bdcf-4afc-b480-5399958e82df => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 15 12:51:53.739918 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e9190bd9-286e-4110-8946-a47931e23313 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:51:53.740423 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.compute.api [None req-e9190bd9-286e-4110-8946-a47931e23313 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2] Fetching instance by UUID {{(pid=122567) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:51:53.746972 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e9190bd9-286e-4110-8946-a47931e23313 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:51:53.747349 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e9190bd9-286e-4110-8946-a47931e23313 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:51:53.748111 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e9190bd9-286e-4110-8946-a47931e23313 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:51:53.748533 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG oslo_concurrency.lockutils [None req-e9190bd9-286e-4110-8946-a47931e23313 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:51:53.761187 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.wsgi [None req-e9190bd9-286e-4110-8946-a47931e23313 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] HTTP exception thrown: Instance f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2 could not be found. Nov 15 12:51:53.761764 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-e9190bd9-286e-4110-8946-a47931e23313 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Returning 404 to user: Instance f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2 could not be found. {{(pid=122567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:51:53.762572 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-e9190bd9-286e-4110-8946-a47931e23313 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2" status: 404 len: 111 microversion: 2.1 time: 0.026465 Nov 15 12:51:53.763137 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 630/1232] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Nov 15 12:51:53 2021] DELETE /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 15 12:51:53.770922 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-b84818c2-3661-4fb4-a779-e4709c5beb68 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '>' {{(pid=122568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:51:53.771519 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.compute.api [None req-b84818c2-3661-4fb4-a779-e4709c5beb68 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] [instance: f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2] Fetching instance by UUID {{(pid=122568) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 15 12:51:53.778168 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b84818c2-3661-4fb4-a779-e4709c5beb68 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:51:53.778604 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b84818c2-3661-4fb4-a779-e4709c5beb68 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:51:53.779436 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b84818c2-3661-4fb4-a779-e4709c5beb68 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 15 12:51:53.779866 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG oslo_concurrency.lockutils [None req-b84818c2-3661-4fb4-a779-e4709c5beb68 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Lock "388e2b35-2c0f-43c3-b3c8-e061c392ccce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 15 12:51:53.793578 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.wsgi [None req-b84818c2-3661-4fb4-a779-e4709c5beb68 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] HTTP exception thrown: Instance f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2 could not be found. Nov 15 12:51:53.794142 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: DEBUG nova.api.openstack.wsgi [None req-b84818c2-3661-4fb4-a779-e4709c5beb68 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Returning 404 to user: Instance f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2 could not be found. {{(pid=122568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 15 12:51:53.794985 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO nova.api.openstack.requestlog [None req-b84818c2-3661-4fb4-a779-e4709c5beb68 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2" status: 404 len: 111 microversion: 2.1 time: 0.027601 Nov 15 12:51:53.795507 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: [pid: 122568|app: 0|req: 603/1233] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Nov 15 12:51:53 2021] GET /compute/v2.1/servers/f8365fb3-d5c5-4aa0-8b6b-c93f295f29d2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 15 12:51:55.089236 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: DEBUG nova.api.openstack.wsgi [None req-227090fa-e7a8-4958-9cf4-5c26995ffc77 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] Calling method '.version_select at 0x7f13203c53a0>' {{(pid=122567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 15 12:51:55.114265 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO nova.api.openstack.requestlog [None req-227090fa-e7a8-4958-9cf4-5c26995ffc77 tempest-TestVolumeBootPattern-1585944354 tempest-TestVolumeBootPattern-1585944354-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1935274887" status: 202 len: 0 microversion: 2.1 time: 0.030913 Nov 15 12:51:55.115458 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: [pid: 122567|app: 0|req: 631/1234] 10.222.0.43 () {58 vars in 1262 bytes} [Mon Nov 15 12:51:55 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1935274887 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 15 12:52:56.059390 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 15 12:52:56.060035 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: Mon Nov 15 12:52:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 15 12:54:47.262979 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 15 12:54:47.263583 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: Mon Nov 15 12:54:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 15 12:54:54.785388 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 15 12:54:54.786087 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: Mon Nov 15 12:54:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 15 12:56:16.076806 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 15 12:56:16.077442 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: Mon Nov 15 12:56:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 15 12:56:21.074510 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 15 12:56:21.075294 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: Mon Nov 15 12:56:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 15 12:56:54.119023 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 15 12:56:54.119605 dv-cinder-680889-10-iscsi devstack@n-api.service[122568]: Mon Nov 15 12:56:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 15 12:57:04.695797 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 15 12:57:04.696401 dv-cinder-680889-10-iscsi devstack@n-api.service[122567]: Mon Nov 15 12:57:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!